Mathematical Analysis of Random Noise 
by s. o. RICE 

(Concluded from July 1944 issue) 

PART III 
STATISTICAL PROPERTIES OF RANDOM NOISE CURRENTS 

3.0 Introduction 

In this section we use the representations of the noise currents given in 
section 2.8 to derive some statistical properties of /(/). The first six sec- 
tions are concerned with the probability distribution of /(/) and of its zeros 
and maxima. Sections 3.7 and 3.8 are concerned with the statistical prop- 
erties of the envelope of /(/). Fluctuations of integrals involving / (/) 
are discussed in section 3.9. The probability distribution of a sine wave 
plus a noise current is given in 3.10 and in 3.11 an alternative method of 
deriving the results of Part III is mentioned. Prof. Uhlenbeck has pointed 
out that much of the material in this Part is closely connected with the 
theory of Markoff processes. Also S. Chandrasekhar has written a review 
of a class of physical problems which is related, in a general way, to the 
present subject." 

3.1 The Distribution of the Noise Current 23 

In section 1.4 it has been shown that the distribution of a shot effect 
current approaches a normal law as the expected number of events per 
second, v, increases without limit. 

In line with the spirit of this Part, Part III, we shall use the representation 

V 

lit) = 2 ( a » cos «-' + b " sin w »0 (2.8-1) 

71=1 

to show that /(/) is distributed according to a normal law. This is obtained 
at once when the procedure outlined in section 2.8 is followed. Since a n 
and b n are distributed normally, so are a n cos coj and b n sin wj when / is 
regarded as fixed. /(/) is thus the sum of 2.V independent normal variates 
and consequently is itself distributed normally. 

- Stochastic Problems in Phvsics and Astronomy, Rev. of Mod. Phys., Vol. 15, pp. 
1-89 (1943). 

28 An interesting discussion of this subject by V. D. Landon and K. A. Norton is given 
in the I.R.E. Proc., 30 (Sept. 1942) pp. 425-429. 
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The average value of /(/) as given by (2.8-1) is zero since d n = b„ = 0: 

/(/) = (3.1-1) 

The mean square value of /(/) is 



Hi) = Z fan cos 2 «„/ + b\ sin 2 o)„/) 

n=l 

= Z KfMf (3.1-2) 

-» /" »(/) # - *(0) - *o 

In writing down (3.1-2) we have made use of the fact that all the a's and b's 
are independent and consequently the average of any cross product is zero. 
We have also made use of 

a\ = b\ = w(f n )Af, f n = nAf, u n = 2tt/„ 

which were given in 2.8. ^(r) is the correlation function of 1(1) and is 
related to w(f) by 

ypr = Hr)= l w(f) cos 2t/t df (2.1-6) 

Jo 

as is explained in section 2.1. In this part we shall write the argument of 
^(t) as a subscript in order to save space. 

Since we know that /(/) is normal and since we also know that its average 
is zero and its mean square value is ^o , we may write down its probability 
density function at once. Thus, the probability of I{t) being in the 
range I, I -\- dl is 

/7 e - /! * (3.1-3) 



This is the probability ot finding the current between / and / + dl at a 
time selected at random. Another way of saying the same thing is to state 
that (3.1-3) is the traction of time the current spends in the range 1,1-}- dl. 

In many cases it is more convenient to use the representation (2.8-6) 

I if) = Z^n cos (o} n t - <p„), ci = 2w(f n )Af (2.8~6) 

in which <pi , • • • ip n are independent random phase angles. In order to 
deduce the normal distribution from this representation we first observe 
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that (-2.8-6) expresses 1(f) as the sum of a large number of independent ran- 
dom variables 

/(/) = Xi + X 2 + ••• + X/f 
Xn = C n COS (a) n t — <Pn) 

and hence that as N — > °° /(/) becomes distributed according to a normal 
law. In order to make the limiting process definite we first choose N and 
A/ such that NAf = F where 



f w (f) df<e[ W(f) df 



where e is some arbitrarily chosen small positive quantity. We now let 
_/y _> oo and A/ — » in such a way that NAf remains equal to F. Then 



w 



A - x\ + X% + • • = • + -4 = E 2w(/ B )A/ COS 2 («„/ - <p n ) 

= X>(/ B )4/-» t w( ^# 

1 ^o 



5 =S I ^ |3 + . . . + | Xn ]> = 2 (2w(f n )*f) m | COS (W„ / - <p n ) |* 

1 

l(Af) m [ F [w(f)f*df 

Jo 



i 



< 

^0 

where the bars denote averages with respect to the <p's, / being held constant. 
If we assume that the integrals are proper, the ratio BA~ m — ► as N — > « , 
and consequently the central limit theorem* may be used if w(f) = for 
f > F. Since we may make F as large as we please by choosing e small 
enough, we may cover as large a frequency range as we wish. For this 
reason we write °o in place of F. 

Now that the central limit theorem has told us that the distribution of 
/(/), as given by (2.8-6), approaches a normal law, there remains only the 
problem of finding the average and the standard deviation: 



I(t) = 2 c n cos (o) n t —<?„)= 
i 

AT 

IHT) = £ A cos 2 (w„* - ipn) (3.1-5) 

-> [ w(f) df = h 
Jo 



* Section 2.10. 
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This gives the probability density (3.1-3). Hence the two representations 
lead to the same result in thl_case. Evidently, they will continue to lead 
to identical results as long as the central limit theorem may be used. In the 
future use of the representation (2.8-6) we shall merely assume that the 
central limit theorem may be applied to show that a normal distribution 
is approached. We shall omit the work corresponding to equations (3.1-4). 
The characteristic function for the distribution of I(t) is 

ave.e <u,<l) = exp - |° u 2 (3.1-6) 

3.2 The Distribution of / (t) and I (t + t) 

We require the two dimensional distribution in which the first variable 
is the noise current I(t) and the second variable is its value /(/ + r) at some 
later time r. It turns out that this distribution is normal 24 , as we might 
expect from the analogy with section 3.1. The second moments of this 
distribution are 

m = IHt)=H= l w(J) df 
Jo 

A*22 = ^0 

(3.2-1) 



/us = I{f)I(t + r) 

The expression for nu is in line with our definition (2.1-4) for the correla- 
tion function: 



fr = Mr) = Limit = [ I(t)I(t + r) dt (2.1-4) 

In order to get the distribution from the representation (2.8-6) we write 

.V 

Ii = I{t) =^c„ cos (u n t — <p n ) 



h = I(t + T) = ^2 C n COS (0J n t — tp n -J- iO n T) 

1 

24 It seems that the first person to obtain this distribution in connection with noise was 
H. Thiede, Elcc. Nadir. Tek. 13 (1936), 84-95. 
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From the central limit theorem for two dimensions it follows that h and h 
are distributed normally. As in (3.1) 



JV 

Mil 



= I\ = Ef'-H f Mf)df= * 

1 •'0 

M22 = 3 = J] = * (3-1-2) 

Ml2 = 7[7 2 = X) c » ave - ( cos ("»' — ^") cos ( Wn * — ^" + C0 » T )} 
i 

Now the quantity within the parenthesis is 

COS 2 («„/ — <p n ) COS W„T — COS (toj ~ <Pn) S\Tl (w„/ — fn) sin W„T 

' and when we take the average with respect to <p n the second term drops 
out, giving 

u M = Z c\-\ cos Un T-^f «;(/) cos 2tt/t <// = iA r (3.2-3) 
i Jo 

where we have usedco n = 2tt/„ and the relation (2.1-6) between w(f) and^(r). 
The probability density function for h and / 2 may be stated. From the 
discussion of the normal law in 2.9 it is 

M - ir 1/2 exD r -w\ - hit + 2+ T hh ~\ (3 2 _ 4) 

2t ' P L 2(*2 - #) J 

For a band pass filter whose range extends from/a to/ 6 we have 

J/ r = I wq cos 2irfr df 

sin war — sin u a r 



= wo 



2ttt 



(3.2-5) 



= — Sin 7Tt(/6 - fa) COS 7Tt(/& + fa) 

7TT 



ypo = Wo(/b — fa) 
where Wo is the constant value of w(f) in the pass band and 

a> b = 2irf b (3.2-6) 

OJ a = 27r/ a 

According to our formula (3.2-4), I\ and h are independent when \p T 
is zero. For the t's which make \{/ T zero, a knowledge of h does not add to 
our knowledge of h . For example, suppose we have a narrow filter. Then 

fc. = when r = [2(f b + / a )] -1 

^ T is nearly — ^o wnen r "* (/» + /"l 
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For the first value of r, all we know is that h is distributed about zero with 
II = \p . For the second value of r h is likely to be near —h ■ This is 
in line with the idea that the noise current through a narrow filter behaves 
like a sine wave of frequency §(/(, +/„) (and, incidentally, whose amplitude 
fluctuates with an irregular frequency of the order of h(fb — fa)). The first 
value of t corresponds to a quarter-period of such a wave and the second 
value to a half-period. By drawing a sine wave and looking at points sepa- 
rated by quarter and half periods, the reader will see how the ideas agree. 
The characteristic function for the distribution of I\ and 7 2 is 

ave. e iuIl+ivI *- = exp T-| (u 2 + v 2 ) - fcml (3.2-7) 

The three dimensional distribution in which 

h = I(t) 

h = 1(1 + n) 

h = I{t + n + to) 

where rj and t 2 are given and t is chosen at random is, as we might expect, 
normal in three dimensions. The moments, from which the distribution 
may be obtained by the method of Section 2.9, are 

Mil = M22 = M33 = "Ao 

J"i2 = &1 

M23 = &, 

M13 = Mj\ + Tt) = ^ Tl +r 2 

The characteristic function for Ti , h , I 3 is 
ave. e i * 1 ' 1+it -'-~ H ' 313 

= ex P - y (si + 32 + S3) - M12S1S2 - M23S2S3 — M1321S3 ' ~ 

3.3 Expected Number of Zeros per Second 
We shall use the following result. Let y be given by 

y = F( ai ,02 , • ■ • a N ; *), (3.3-1) 

and let the o's be random variables. For a given set of a's, this equation 
gives a curve of y versus x. Since the a's are random variables we shall call 
this curve a random curve. Let us select a short interval .\\ , X\ -f dx, 
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and then draw a batch of a's. The probability that the curve obtained by 
putting these a's in (3.3-1) will have a zero in x\ , xi + dx is 

dx / \r}\p(0,r,;xi)dri (3.3-2) 

J— oO 

and the expected number of zeros in the interval (xi , x%) is 

I'* dx [ \v\P(0,v;x)dr, (3.3-3) 

J x\ J— to 

In these expressions />(£, tj; x) is the probability density function for the 
variables 



£ = -F(ai , • • • a.v; x) 
dF 



(3.3-4) 



Since the a's are random variables so are £ and 77, and their distribution 
will contain x as a parameter. This is indicated by the notation p(£, i\\ »). 

These results may be proved in much the same manner as are similar 
results for the distribution of the maxima of a random curve. This method 
of proof suffers from the restriction that the o's are required to be bounded."'' 
Results equivalent to (3.3-2) and (33-3) have been obtained independently 
by M. Kac. 26 His method of proof has the advantage of not requiring the 
a's to be bounded. 

Here we shall sketch the derivation of a closely related result: The prob- 
ability that y will pass through zero in Xi , a*i + dx with positive slope is 

dx / vpi®, v; *i) dt\ (3.3-5) 

Jo 

We choose dx so small that the portions of all but a negligible fraction 
of the possible random curves lying in the strip (x\ , .xi + dx) may be re- 
garded as straight lines. If y = £ at X\ and passes through zero for Xi < X < 

xi + dx, its intercept on y = is X\ — - where 77 is the slope. Thus £ and 77 

must be of opposite sign and 

t 
Xi < x± — - < Xi + dx 

= 5 S. O. Rice, A mer. Jour. MalM Vol. 61, pp. 409-416 (1939). However, L. A. MacColl 
has pointed out to me -that a set of sufficient conditions for (3.3-5) to hold is: (a) />(£, 77; v) 
is continuous with respect to (e, v ) throughout the fr-plane; and (b) that the integral 

/ p(a-o, ij; xi) dr, 
h 

converges uniformly with respect to a in some interval — a v < a < a 2 , where at and a 2 
are positive. These conditions are satisfied in all the applications we shall make use of 
(3.3-5). 

2" M. Kac, Bull. Amer. Math. Soc. Vol. 49, pp. 314-320 (1943). 
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According to the statement of our problem, we are interested only in positive 
values of 77, and we therefore write our inequality as 

-r)dx < £ <0 

For a given random curve i.e. for a given set of a's £ and 17 have the values 
given by 

£ = F(ai , -•■ a N ;xi) 

If these values of £ and rj satisfy our inequality, the curve goes through zero 
in Xi , xi -f dx. The probability of this happening is 27 

[ d-o I dtpd;, V ; xi) = [ [0 - (-T]dx)]p(0, V ; x x ) dr, 

where we have made use of the fact that dx is so very small that £ is effec- 
tively zero. The last expression is the same as (3.3-5). 

In the same way it may be shown that the probability of y passing through 
zero in X\ , X\ + dx with a negative slope is 

-dx I V p{0, V ; x x ) d n (3.3-6) 

•*— » 

Expression (3.3-2) is obtained by adding (3.3-5) and (3.3-6). 

We are now ready to apply our formulas. We let t, l(t) and y?„ play the 
roles of .v, y, and a„ , respectively, and use 

N 

I(t) = £ c n cos (<a n t - p.), c\ = 2w(f)Af (2.8-6) 

27 MacColl has remarked that the step from the double integral on the left hand side 
of this equation to the final result (3.3-5) may be made as follows: 
It is easily seen that the probability density we are seeking is 

Proceeding formally, without regard to conditions validating the analytical operations 
(for such conditions see the footnote on page 52), we have 

d f" f° r" 

dtel dl> I p( *' *' x) d * = / iPt-i*** r, x) dr, 

and hence the required probability density is 

/ vp(0, v ; x) dr) 
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The first step is to find the probability density function of the two random 
variables 

N 
£ = 2 C n COS (o)„ h — <Pn) 

(3.3-7) 
rj = /'(/i) = — X) c n w„ sin (w„/i — v>n) 

n=l 

where the prime denotes differentiation with respect /. From section 2.10 

Mn - ? = h 



m — v 2 = 2 c " w » s * n2 ( Wn tx ~~ V") 

n=l 

= f: (2T0w(f a )Af 

n=l 

-> 4tt 2 ffw{f) df = -tf 



M12 



= £17 = — 2 c » w « cos ( a, «' 1 — ^») sm ( Wn ^ — ^ 



= 



The expression for /x 22 arises from (2.1-6) by differentiation. In this expres- 
sion i/'o' denotes the second derivative of *(r) with respect to r at t = 0: 

J,»(t) = -4tt 2 f fw(J) cos 2*/r <// (3.3-8) 

Jo 

Hence the probability density is 



Pfa V, t) = 



[—ipo^ 



"1-1/2 





2tt 



exp 



L 2tfo 2^? J 



(3.3-9) 



where rf is negative. It will be observed that the expression on the right 
is independent of /. Hence the probability of having a zero in h , h + dt, 

which follows from (3.3-3) , is independent of /. 

The expected number of zeros per second, which may be obtained from 
(3.3-3) by integrating (3.3-10) over an interval of one second, is 

- f » -ii/2 

| fw(J)df 
Jo 



iT(o)l 






fwifidf 
-Jo 



(3.3-11) 
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For an ideal band pass filter whose pass band extends from/,, to/& the 
expected number of zeros per second is 



L3/6-/J 



(33-12) 



When/„ is zero this becomes 1.155 /a and when /„ is very nearly equal to 
fb it approaches /&+/„. 

In a recent paper M. Kac has given a result which, after a slight gene- 
ralization, leads to 

for the probability that the noise current will pass through the value / 
with positive slope during the interval /, / -f- dt. The expected number of 
such passages per second is 

e~' /2 *° X \h the expected number of zeros per second] (3.3-14) 

The expression (3.3-13) may also be derived from analogue of (3.3-5) 
obtained by replacing the zero in p((), tj; .Vi) by y. 
In some cases the integral 



tf = -47T 2 [ fw(f)df 

Jo 



does not converge. 

An example occurs when we apply a broad band noise voltage to a re- 
sistance and condenser in series. The power spectrum of the voltage across 
the condenser is of the form 

«'(/) = j^r-, (3.3-15) 

J T & 

Although \f/ n is infinite, \f/ is finite and equal to ir/2a. A straightforward 
substitution in our formula (3.3-11) gives infinity as the expected number 
of zeros per second. 

Some light is thrown on this breakdown of our formula when we consider 
a noise current consisting of two bands of noise. One band is confined to 
relatively low frequencies, and its power spectrum will be denoted by 
w\(f). The other band is very narrow and is centered at the relatively high 
frequency /o . The complete power spectrum of our noise is then 

w(f) = w t (f) + A-8(f - ft) 

28 On the Distribution of Values of Trigonometric Sums with Linearly Independent 
Frequencies, Amer. Jour. Math., Vol. LXV/pp 609-615, (1943). 
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where the unit impulse function 5 is used to represent the very narrow band. 
The power spectrum of the narrow band is approximately the same as that 
of the wave A-\/2 cos lirfit. 
The integrals occurring in our formula are 



I W W d f = I m W df + A * 



= W + A 2 

C Mf)f df = ffvhU) df + A*A 
Jo J o 

- V + A 2 f\ 
We suppose that A and / 2 are such that 

W» A 2 

U « A 2 fl . 
Then our formula (3.3-11) gives us the expected number of zeros 

7 Af L 

We may give a qualitative explanation of this formula if we regard our 
noise current as composed of a small component 

h = 2 1I2 A cos 2irf 2 t 

due to the narrow band superposed on a large, slowly varying component 
due to the lower band. Since the r.m.s. value of the second component is 
W 1 ' 2 we may assign it a representative frequency /i and write it approxi- 
mately as 

h = (2W) 1/2 cos lirfxt 
The zeros of the noise current are clustered around the zeros of the second 
wave. Near such a zero 

h = ±(2W) ll2 2TfiAt 
where At is the distance from the zero. The oscillations of h produce zeros 
when | h | is less than the amplitude of h or when 

A > W ll2 2irfi | At | 
and the interval over which zeros are produced is given by 

TCfl 
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The number of zeros is this multiplied by 2/ 2 . Since there are 2/i such 
intervals per second the number of zeros per second is 

4 , „_l/2 , 



7T 



AW^fi 



This differs from the result given by our formula by a factor of 2/w. 
This discrepancy is due to our representing the two bands by the sine waves 
/, and I,. 

From this example we obtain the picture that when the integral for i^o 
converges corresponding to A — > 0, while at the same time the integral for 
^o diverges, corresponding to / 2 — > co in such a way that Aft — * °o , the 
noise current behaves something like a continuous function which has no 
derivative. It seems that for physical systems the integrals will always 
converge since parasitic effects will have the effect of making w(f) tend to 
zero rapidly enough. The frequency which represents the region where 
this occurs is of the order of the frequency of the microscopic wiggles. 

So far we have been considering the formulas of this section in the most 
favorable light possible. There are experiments which indicate the possi- 
bility of the formulas breaking down in some cases. Prof. Uhlenbeck has 
pointed out that if a very broad band fluctuation current be forced 29 to flow 
through a circuit consisting of a condenser, C, in parallel with a series com- 
bination of inductance, L, and resistance, R, equation (3.3—11) says that the 
expected number of zeros per second of the current, /, flowing through R 

(and L) is independent of R. It is simply -(LCf . The differential 

T 

equation for / is the same as that which governs the Brownian motion of a 
mirror suspended in a gas 30 , the gas pressure playing the role of R. Curves 
are available for this motion and it is seen that their character depends 
greatly upon the pressure 31 . Unfortunately, it is difficult to tell from the 
curves whether the expected number of zeros is independent of the pressure. 
The differences between the curves for various pressures indicates that there 
may be some dependence*. 

3.4 The Distribution of Zeros 
The problem of determining the distribution function for the distance 
between two successive zeros seems to be quite difficult and apparently 

20 For example, by putting the circuit in series with a diode. 

30 This problem in Brownian motion is discussed by G. E. Uhlenbeck and S. Goudsmit, 
Pliys., Rev., 34 (1929), 145-151. 

31 E. Kappler, Annalen d. Pliys., 11 (1931) 233-256. 

* Since this was written M. Kac and H. Hurwitz have studied the problem of the ex- 
pected number of zeros using quite a different method of approach which employs the 
"shot-effect" representation (Sec. 3.11). Their results confirm the correctness of (3.3-11) 
when the integrals converge. When the integrals diverge the average number of elec- 
trons, per sec. producing the shot effect must be considered. 
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nobody has as yet given a satisfactory solution. Here we shall give some 
results which are related to the general problem and which give an idea of 
the form of the distribution for the region of small spacings between the 

zeros. 

We shall show (in the work starting with equation (3.4-12)) that the 
probability of the noise current, /, passing through zero in the interval 
Tf T _|_ dr with a negative slope, when it is known that / passes through zero 
at t = with a positive slope, is 

t[^s]" [ **] ( *° ~ * rni + H cot ' 1( -" )] (3 - 4_1) 

where M22 and M33 are the cofactors of M22 — — fa and /123 = —fa in the 
matrix 



M = 



Vfa 





*, 


fa 





1" 

—fa 


-*: 


~+'r 


4 


-?. 


1" 

—fa 





jh 


-*', 





fa_ 



(3.4-2) 



II = M23WI2 - Ml 3 ] 



2 -1-1/2 



We choose < cot -1 (— E) < ir, the value t being taken at t = 0, and the 
value 7t/2 being approached as r — > » . It should be remembered that we 
are writing the arguments of the correlation functions as subscripts, e.g., 
— \J/ T is really 

-V{r) = 4/ [ fw(f) cos2Tfrdf (3.3-8) 

Jo 

As t becomes larger and larger the behavior of / at t is influenced less 
and less by the fact that it goes through zero with a positive slope at t = 0. 
Hence (3.4-1) should approach the probability that, for any interval of 
length dr chosen at random, I will go through zero with a negative slope. 
Because of symmetry, this is half the probability that it will go through 
zero. Thus (3.4-1) should approach, from (3.3-10), 



t[z£V 

2tt L fa J 



(3.4-3) 



as r 



It actually does this since M approaches a diagonal matrix 



and both Afss and // approach zero with M23/H 
low pass filter cutting off at/* (3.4-3) is 



M 



22 



2 ," 



— i^o^o- For a 



The behavior of (3.4-1) as t 



drf£- m (3.4-4) 

is quite a bit more difficult to work out. 
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Mo 2 and M 23 go to zero as t 4 , M\i — M\ z as r 10 , and consequently H goes 
to infinity as t~\ The final result is that (3.4-1) approaches 



8 L —toto J 



as t — > 0, assuming ^ <4) exists. Here the superscript (4) indicates the fourth 
derivative at r = 0, 

ft? = W / fw{f) df (3.4-6) 

Jo 

For a low pass filter cutting off at/& (3.4-5) is 

dT k {2irfb) * (3 - 4_7) 

When (3.4-1) is applied to a low pass filter, it turns out that instead of t 
the variable 

ip = 2irf b T, d<p = 2wf b dr (3.4-8) 

is more convenient to handle. Thus, if we write (3.4-1) as p(<p) dip, it fol- 
lows from (3.4-4) and (3.4-7) that 



1 
2ttV3 



P(<p) -♦ ^T7t = -0919 as <p 



Pifp) — * Jq a s <p 



(3.4-9) 



p{<p) has been computed and plotted Oh Fig. 1 as a function of <p for the 
range to 9. From the curve and the theory it is evident that beyond 
9 p(<p) oscillates about 0.0919 with ever decreasing amplitude. 

We may take p(<p) dip to be the probability that / goes through zero in 
tp, <p + d<p, when it is known that / goes through zero at tp = with a slope 
opposite to that at ip. p(ip) dip exceeds the probability that / goes through 
zero at ip = and in ip, ip + dip with no zeros in between. This is because 
p(<p) dip includes all curves of the latter class and in addition those which 
may have an even number of zeros between and tp. From this it follows 
that the curve giving the probability density of the intervals between zeros 
must be underneath the curve of p(ip). 

A partial check on the curve for p(ip) may be obtained by comparing it 
with a probability density function obtained experimentally by M. E. 
Campbell for the intervals between 754 successive zeros. He passed thermal 
noise through a band pass filter, the lower cutoff being around 200 cps and 
the upper cutoff being around 3000 cps. The upper cutoff was rather grad- 
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ual and it is difficult to assign a representative value. The crosses on figure 
1 are obtained from his data when we assume that his filter behaves like a 
low pass filter with a cutoff at f b = 2850, this choice being made in order 
to make the maximum of his curve coincide with that of p(<p). 

It is seen that some of the crosses lie above p(<p). This is probably due 
to the fact that the actual filter differs somewhat from the assumed low pass 

filter. 

On Fig. 1 there is also plotted a function closely related to (3.4-1). It 
is the low pass filter form of the following: The probability of I passing 
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Fig. 1— Distribution of intervals between zeros — low-pass filter 
y A A v is probability of a zero in A<o when a zero is at origin. 

y B A<p is probability of a zero in -V when a zero is at origin and slopes at zeros are of 
opposite signs. 

y B = p(<p),f b = filter cutolT, r = time between zeros. 

through zero in r, r + dr when it is known that / passes through zero at 
t = Ois 



where the notation is the same as in (3.4-1) and — - < tan H < - . 

This curve should always lie above p(<p) and the small difference between 
the curves out to <p = 4 indicates that [the true distribution of zeros is given 
closely by p(<p) out to this point. 

When (3.4-1) is applied to a relatively narrow band pass filter or some 
similar device we may make some approximations and obtain an expression 
somewhat simpler than (3.4-1). As a guide we consider our usual ideal 
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band pass filter whose range extends from/ a to/ 6 . The correlation function 
is given by (3.2-5). 

ypr = — Sin 7Tt(/ 6 - f a ) COS 7Tt(/ 6 + f a ) 

97 (3.2-5) 

<Ao = Wo{fb — fa) 

From physical considerations we know that in a narrow filter most of the 
distances between zeros will be nearly equal to 

1 

Tl = 



fi+fa 

i.e., nearly equal to the distance between the zeros of a sine wave having 
the mid-band frequency. We therefore expect (3.4-1) to have a peak very 
close to n . We also expect peaks at 3n , Sn etc. but we shall not consider 
these. We wish to examine the behavior of (3.4-1) near n . 

It turns out that M 23 is nearly equal to Jlf» so that 11 is large and (3.4-1) 
becomes approximately 

drV h "I" 2 M a 

where t is near r\ . 

In order to see that M23 is nearly equal to M99 we use the expressions 

Mil = —^0(^0 - ti) — i/'o'At 2 
M 23 = tfblf - fy 4- M? 

Mn + M 23 - (h - *,)[(fc + 4>r){ti - $) - +?\ 

= (* - + T )[B + C] 
M 22 - M 23 = (^0 + ft)[(fc - *,)(- *? ~ tf) - *?] 

= (*o + *,)[- 5 + C] 

B = Ipolpr — <At^0 

C = — $flAo + "Ar^r — <Ar 2 

From (3.2-5) it is seen that \}/ T may be written as 

ir = AcOSt3T, /3 = Tr(f b +f a ) 

where 0n = ir and A is a function of r which varies slowly in comparison 
with cos /3t. We see that near n , \p T is nearly equal to — \J/ Q . Likewise 
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yp'r hovers around zero and $' is nearly equal to -i/'o . Differentiating with 
respect to t gives 

\f/' T = A' cos |St - J/3 sin /3r 
#' = (.-1" - J/3 2 ) cos fir - 2A'& sin 0t 
^' = 4? - Jo/3 2 , *o = ^4o 
where Jo and j" are the values of A and its second derivative at r equal 
to zero. These lead to 

B = (A A" - A A") cos/3t - 2JoJ'/3sin0T 

C = (A A" - A' 2 ) cos 2 /3r - J X' + (A 2 - A)Y 

We wish to show that C + B and C — -B are of the same order of magni- 
tude. If we can do this, it follows that M n — M i3 is much smaller than 
M 22 + Mm since \p — Vs is approximately 2^ while ^0 + tfvi is quite small. 
Consequently we will have shown that M 23 is nearly equal to M22 . 

So far we have made no approximations. We now express the slowly 
varying function A as a power series in r. Since \p and \f/ must be zero 
for the type of functions we consider, it follows that 

A -Ao + jA" + •• 

A' = tAo + •• 

a" = a': + \a^ + •• 

where we neglect all powers higher than the second. Multiplication and 
squaring gives 



A 2 - Al = t 2 A q A 



o^io 

2 



AA » - A' 2 = A A« + \ {AoAi 4) - A' ' 2 ) 

- Jo^o' + F 

AW - AA'l = \ {AoA? - A?) = F 

Since, for small t, A and J" are nearly equal to A and A", respectively 
we see that the difference on the left is small relative to AoA , i.e., 

\F\ << \AoA"\ 
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Our expression for B and C become approximately 

B = F cos 0t - 2AoAo'pr sin /3t 

C = F cos 2 T - AoA" sin 2 0r - AoA'o'&V 

When r is near t\ , 0t is approximately tt. Hence both C + B and C — B 
are approximately — Ao A 7r 2 and are of the same order of magnitude. Con- 
sequently Afoo and M 23 are both nearly equal and 

Mm = HC + B] 

— — .do-^oTr 

When this expression for M23 is used our approximation to (3.4-1) gives 
us the result: If the correlation function is of the form 

rf/ T = A cos /3t 

where A is a slowly varying function of t, the probability that the distance 
between two successive zeros lies between r and r + dr is approximately 

dr a 

J 11 + a 2 (r - nW 2 

where a is positive and 

2 -4o/3 2 

fl . = // 2 , Ti = - 

For our ideal band pass filter with the pass band/ 6 — f a , 



/ft "/a /*+/« 

and the average value of | r — n | is a~ . Thus 

a ve. Jt — ti | _ 1 _f b — /„ _ 1 band width 

n an y/$ (f b -f f a ) 2-\/3 mid-frequency 

When the correlation function cannot be put in the form assumed above 
but still behaves like a sinusoidal wave with slowly varying amplitude we 
may use our first approximation to (3.4-1). Thus, the probability that the 
distance between two successive zeros lies between t and t + dr is approxi- 
mately 

bdr 

M - +ir 

when r lies near n where n is the smallest value of r which makes \f/ T 
approximately equal to — ^0. This probability is supposed to approach 
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zero rapidly as r departs from n , and b is chosen so that the integral over 
the effective region around ti is unity. 

It seems to be especially difficult to get an expression for the distribution 
of zeros for large spacing. One method, suggested by Prof. Goudsmit, is 
to amend the conditions leading to (3.4-1) by adding conditions that / be 
positive at equally spaced points along the time axis between and t. 
This leads to integrals which are hard to evaluate. For one point between 
and t the integral is of the form (3.5-7). 

Another method of approach is to use the method of "in and exclusion" 
of zeros between and t. Consider the class of curves of / having a zero 
at T = 0. Then, in theory, our methods will allow us to compute the func- 
tions po(r), pi(r, r), pi(r, s, r); associated with this class where 
po(r) dr is probability of curve having zero in dr 
pi(r, t) dr dr is probability of curve having zeros in dr and dr 
p 2 (r, s, t) dr dr ds is probability of curve having zeros in dr, dr, and ds 
In fact po(r) dr is expression (3.4-10). The method of in and exclusion 
then leads to an expression for P (r) dr, the probability of having a zero 
at and a zero in r, t + dr but none between and r. It is 

Po(r) = MO ~Y\j P l{r > T)dr + T\i I p - {r ' s ' t) drds 

-Ti f f [ Mr,s,t,r)drdsdt + 
3 ! Jo Jo Jo 

Here again we run into difficult integrals. Incidentally, (3.4-11) may be 
checked for events occurring independently at random. Thus if v dr is 
the probability of an event happening in dr, then, if v is a constant and the 
events are independent, we have fa, pi, pt, ••' given by v, v , v , • • ■ . 
From (3.4-11) we obtain the known result Po(t) = ve "'. 

We shall now derive (3.4-1). The work is based upon a generalization of 
(3.3-5): If y is a random curve described by (3.3-1), the probability that y 
will pass through zero in x\ , oc x + d.\\ with a positive slope and through 
zero in x% , x? + dxi with a negative slope is 

—dxidxil drji I drurnwpiO, rji , Xi] 0, r/ 2 , X*) (3.4-12) 

where p(fo , 771 , Xi ; fc , m , x 2 ) is the probability density function for the 
four random variables 

& = F(ai ,(h, • • • , o K ; x t ) 



(3.4-11) 
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The xi and xi play the role of parameters in (3.4-12). This result may be 
established in much the same way as (3.3-5). 

When we identify F with one of our representations, (2.8-1) or (2.8-6), 
of the noise current /(/) it is seen that p is normal in four dimensions. We 
may obtain the second moments directly from this representation, as has 
been done in the equations just below (3.3-7). The same results may be 
obtained from the definition of ^(t), and for the sake of variety we choose 
this second method. We set *i = h , .r 2 = h + f . Then 



&6 = /(/)/(/ + t) = + T (3.4-13) 



*?1*?2 



- (U) (in) = Lknit I f r <* + r W® * 

\dt/t\dl/t+T t— oo 1 Jo 



where primes denote differentiation with respect to the arguments. Inte- 
grating by parts: 

f I'{t + r) dlify = [/'(/ + T)/(0]o r - f *"(* + r)I(t) dt 
Jo Jo 

We assume that / and its derivative remains finite so that the integrated 
portion vanishes, when divided by T, in the limit. Since 



we have 



Setting t = gives 



/"(/ + t) = ~ 7(1 + r) 

OT- 



d 2 

OT- 



2 2 ," 

m — m = — ^o 



in agreement with the value of /* 2 2 obtained from (3.3-7). In the same 
way 

£S = Limit I [ I'(t + T )J(0 * = I- *(r) 

T— oo i JO "T 

g^ = Limit ^ ( /'(/)/(/ + r) A 

7'-»W i JO 
= " (-)ff I'(t + T)I(t)dt 
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where we have integrated by parts in getting £ 2 »?i • Setting r = and using 
^o = gives 

£i*?i = £2172 = 

In order to obtain the matrix M of the second moments /i rs in a form 
fairly symmetrical about its center we choose the 1, 2, 3, 4 order of our 
variables to be £1 , 171 , 772 , £2 . From equations (3.4-13) etc. it is seen that 
this choice leads to the expression (3.4-2) for M. 

When we put £1 and £ 2 equal to zero, we obtain for the probability density 
function in (3.4-12) the expression 

exp — . (M 2 2»?i + 1M-m\\ 772 + Af 33*72) 



4tt 2 r L 2 1 M . 

Because of the symmetry of M, M22 is equal to A/33 • When, in the integral 
(3.4-12) we make the change of variable 






r M22 t /2 r M22 i m 

l2\M\] *> y= ~J\M\] * 



we obtain 



dxi dx-z I M | 3 ' 2 



7T 2 M22 JO JO 



I x dx I dy ye v ' 
Jo Jo 



+2(il 2 j/JI/22)*» 



The double integral may be evaluated by (3.5-4). Let 

„ = cos" 1 (- ^) = cot" 1 (-H), E = M n [Mh - M\ 3 T in 

where H is the same as that given in (3.4-2). Our expression now becomes 

'dxidxt I M 1 3/2 . 

■ , 772 772 [1+27 cot (-27)] 

47T 2 M 2 2 — M 2 3 

From a property of determinants 

Using this to eliminate | M | and dividing by 



• L *o J 



^.ti r — 
2T 



which, from (3.3-10), is the probability of going through zero in Xi , X\ + dx\ 
with positive slope, gives the probability of going through zero in dx 2 with 
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P [~-VT W - Mh] m (+l - *;r 3/2 [l + H cot" 1 (-Z7)] 



negative slope when it is known that / goes through zero at x\ with positive 
slope: 

2\ 

This is the same as (3.4-1). 

The expression (3.4-10) is the same as the probability of / going through 
zero in dr when it is known that / goes through zero at the origin with posi- 
tive slope. This second probability may be obtained from (3.4-1) by add- 
ing the probability that / goes through dr with positive slope when it is 
known to go through zero with positive slope. Thus we must add the ex- 
pression containing the integral in which the integration in both rji and rj 2 
run from to « . In terms of X and y this integral is 

f xdx f dyye-*-"*-*"""'***' 

Jo Jo 

This is equivalent to a change in the sign of M 23 and hence of H. After 
this addition we must consider 

1 + II cot -1 (-//) + 1 - H cot" 1 H 
= 2 + 11 [cot -1 (-II) - cot -1 II] 
= 2 + HW - 2 cot -1 II] 
= 2[1 + // tan -1 H] 
and this leads to (3.4-10). 

3.5 Multiple Integrals 
We wish to evaluate integrals of the form 

j = r dxi f dx 2 e- z '- 2azi1 "--^ (3.5-1) 

Jo Jo 

Our method of procedure is to first reduce the exponent to the sum of 
squares by a suitable linear change of variable and then change to polar 
coordinates. This method appears to work also for triple integrals of the 
same sort, but when it is applied to a four-fold integral, the last integration 
apparently cannot be put in closed form. 

The reduction of the exponent to the sum of squares is based upon the 
transformation: If* 

xi = fayi + h D 2 iy 2 + h 3 D 3 iy 3 + • • • + h n D n ,iy n 

xz = -\-hD22y2-\- ••• + h n D n «y n (3.5-2) 

Xn = +0 + ••• +0 + h n D n , n y n 

* T. Fort, Am. Math. Monthly, 43 (1936), pp. 477-481. See also Scott and Mathews, 
Theory of Determinants, Cambridge (1904), Prnb. 63, p. 276. 
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where Do — 1, D\ = an , A-.r = D r -i , and Z) rs is the cof actor of a, r (or 
of a rt because they are equal) in D T : 



D r = 



On 0l2 • " ' Air 

fll2 022 

air • ■ ' flrr 



-1/2 



h r = [xw>,n", 



then, if none of the D r 's is zero, 

2 OnXrX, = y\ + y\ + • • • + y 2 n 

i 

From (3.5-2); the Jacobian d{\\ , • • • x„)/d(yi , ••• y n ) is equal to Z>„ 1/2 . 
Applying our transformation to the exponent: 

&i — yi — aDJ in ya 

X2 = + Di" 1/2 y2 

A = 1 - a 

Since :v 2 runs from to oo so must y 2 . The expression for X\ shows that yi 
runs from a D7 y 2 to » . The integral is therefore 



/-•uff* 1 r^ 2 r 

Jo Ja,,- 1 ' -i 



dyt 



J "i> D j'"i(i 

We now change to polar coordinates: 
yi = p cos " 
^2 = p sin V 
y 2 >0 gives < d < r 
yx > aD 2 m y 2 gives cot 6 > aD 2 m 



dyi dy 2 = pdpdd 



and obtain 



rl«D7'" 



/ = Pa" 1 ' 2 



</# / pe p op 



/ dd L 

Jo Jo 

= \U 2 ~ m cor 1 {aD 2 m ) 

where the arc-cotangent lies between and ir. This may be written in the 
simpler form 

/ = |(1 - a)~ m cos -1 a = \<p esc <p 

where 

a = cos <p, 

it being understood that < <p < ir. 
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Other integrals may be obtained by differentiation. Thus from 

f dx f dy e ~ x2 -» 2 - 2lv C09 * = fa esc , (3.5-3) 

Jo Jo 

we obtain 

f dx f dy xy e-^-v*-^™* * = J C sc 2 <p(l - <p cot <p) (3.5-4) 

Jo Jo 

By using the same transformation we may obtain 

f^jf^-"-'- 2 "" 4'iT. (3 ' 5 " 5) 

Of course, we may expand part of the exponential in a power series and 
integrate termwise but this leads to a series which has to be summed in each 
particular case: 

f 7 r J n m — i 2 — i/ 2 — 2axy 

I dx I dyx y e 

If we take -1 < R(m) < -\, -1 < Rim) < -f, the series may be 
summed when a = 1. The result stated just below equation (3.8-9) is ob- 
tained by continuing m and n analytically. 

The same methods will work when the limits are ± °e . We obtain, when 
m and n are integers, 

,+00 ,«+°0 

m —i 2 — J/ 2 — 2xy cos <p 



£+00 i.+°° 

<fo / dy a;" y 
00 «l-oo 



fO, » + « odd 

An -f- w + A (3.5-6) 

*• ; V * (sin^)" +m+1 

n + w even 



/ 1 — « — ml — cos <A 
F ^- M '- W ' 2 5 2 J' 

The hypergeometric function may also be written as 

_ / n m 1 — n — m . 2 > \ 
F (-2'-2 ; 2 < Sm V 
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By transformations of this we are led to the following expression for the 
integral 

0, n + in odd, 



r(= + !)r(l + !) 



(sin ip) n + m+l 



, . , n m I 2 
* ~2 ' ~ 2 ' 2 ' ° OS * ' ' W ' W 6Ven ' 



-2 



(sin y) „ +m+ , cos ♦J'^-j- , -j- i - 2 i cos ,j, 



*w, « odd 

As was mentioned earlier, the method used to evaluate the double inte- 
grals may also be applied to similar triple integrals. Here we state two 
results obtained in this way. 

/ dx I dy I dz exp [— x 2 — y — z 2 — Icxy — 2bzx — 2ayz] 

/dx / dy I dz yz exp [— x 2 — y 2 — s 2 — Icxy — 2bzx — 2ayz] 

_ V* fl + a - b - c a - be ~| 

- 8A L T+^ - - "^72- (« + ^ + T - -)J (3.5-7) 

where /3 and 7 are obtained by cyclic permutation of a, b, c from 

* a-cb = . _, 1" D 3 J 2 

(1 - «P)W(1 - 62)1/2 Sm [ (1 _ C 2) (1 _ £2) J 



a = cos 



, a — be 

= COt n i/2 



where a, /?, 7 all lie in the range 0, -k and where 



D» = 



1 


c 


b 


c 


1 


a 


b 


a 


1 



= I + 2abc- a 2 - b 2 - c 2 



For reference we state the integrals which arise from the definition of the 
normal distribution given in section (2.9) 



m dx> ■■■J x dx„ exp |_-E a n x r x,j = [ w j 

/+« -+=0 r " ~i r n ~i 

dxi •• • I dx„x t x u exp | — 2 o-r»x r x, = . — ■- 



-4,« 



(3.5-8) 
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where the quadratic form is positive definite and | a | is its determinant. 
A , u is the cofactor of a lu . Incidentally, these may be regarded as special 
cases of 

£ + " dXy • • ■ f dXnfrt, Or.X T xA F \Y, b r X r J 

<f f n-l-Il/2 r +oo «» 

= , A rr I *W **y f& + fi 



(3.5-9) 



2J A r ,b,bt 



-1/2 

i 

-. J 

which is a generalization of a result given by Schlomilch.* 

3.6 Distribution of Maxima of Noise Current 

Here we shall use a result similar to those used in sections 3.3 and 3.4. Let 
y be a random curve given by (3.3-1), 

y = F{ai ••■ a N ;x). (3.3-1) 

If suitable conditions are satisfied, the probability that y has a maximum in 
the rectangle (.vi , Xi + dx\ , yx , }'i + dyi), d.\\ and dyi being of the same 
order of magnitude, is " 



■dxtdytf P(yi,0,t)tdt 



(3.6-1) 



and the expected number of maxima of y in a < % < b is obtained by in- 
tegrating this expression over the range — <* < y x < w, a < X\ < b. 
Pit, V, f) is the probability density function for the random variables 



€ = F(a x , ■ 



, a.v ; ^i) 



(3.6-2) 



* \dx*U , 



* HSheren Analysis. Braunschweig (1879), Vol. 2, p. 494, equ. (29). 

32 Am. Jour. Math., Vol. 61 (1939) 409-416. A similar problem has been studied by 
E. L. Dodd, The Length of the Cycles Which Result From the Graduation of Chance 
Elements. Ann. Math. Stat.. Vol. 10 (1939) 254-264. He gives a number of references 
to the literature dealing with the fluctuations of time series. 
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In our application of this result we replace x and y by / and / as before. 
Then 

.V 

£ = / = 2 C n COS (o.-»/ — if n ) 

1 

v = r 
r - r 

where the primes denote differentiation with respect to /. According to the 
central limit theorem the distribution of £, 77, f approaches a normal law. 
The second moments defining this law may be obtained either from the 
above definitions of £, 77, £" , or may be obtained from the correlation[function 
as was done in the work following equation (3.4-13). 

? = fa, v 2 = —fat l>? * 

S = I'(t)I"{t) = Limit i [ /'(/)/"(/) dt 

T-*ao 1 JO 

= Limit -?- [I'\T) - / /2 (0)] = 



-.=• IT 

.r 

dt 



& = Limit i f /(/)/"(/) 



T—ta 1 JO 

.,2 



= Limit *«L> = tf 

t-0 OT 2 



.?- = Limit 1 [ /"(/)/"(/) A 

T-»co i JO 

= Limit ^ / I w (t)I(t)dt 

T-*<x> 1 JO 



— /< 4 > 
= WO 

where the superscript (4) represents the fourth derivative. The matrix M 
of the moments is thus 



wo 





1" 
—Wo 


1 "~I 

V 



1" 

_W0 








M = 

The determinant | M | and the cofactors of interest are 

I M I = -ff (Wf - -Ao' 2 ) (3.6-3) 
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The probability density function in (3.6-1) is 
*(/,0,f) = (27r)- 3/2 |M|- 1/2 exp 
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L 2|M 



{M n I- + Mnf + 2MnU) 



] 



(3.6-4) 



and when this is put in (3.6-1) and the integration with respect to f per- 
formed we get 



dl dt 



(2_ 

M33 



1/2 -Jtf u /2/2lA/l 
6 






(3.6-5) 



for the probability of a maximum occurring in the rectangle dl dt. As is 
mentioned just below expression (3.6-1), the expected number of maxima 
in the interval h , h may be obtained by integrating (3.6-1) from h to h 
after replacing x by /, and / from — oo to + oo after replacing y by /. When 
we use (3.6-4) it is easier to integrate with respect to I first. The expected 
number is then 

Hence the expected number of maxima per second is 

f fw{J) df 
Jo 



(4) -1X/2 



2»L-*?J 



_ / /V(y) <// 



(3.6-6) 



For a band pass filter, the expected number of maxima per second is 

'sfi-AT 



Lsfi-fJ 



(3.6-7) 



where fb and /„ are the cut-off frequencies. Putting /„ = so as to get a 
low pass filter, 



ft 



ur = - mu 



(3.6-8) 
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From (3.6-8) and (3.6-5) we may obtain the probability density function 
for the maxima in the case of a low pass filter. Thus the probability that 
a maximum selected at random from the universe of maxima will lie in 
I, I + dl is 



dl 



3v / 2th/' () _ 
where 



2er 9 " 2/8 -f(- 



1/2 / A\ 1/2 \~l 

y,-' 2/2 (l+erf;y(jj jj 



y ~ Vio 



(3.6-9) 
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Fig. 2 — Distribution of maxima of noise current. Noise through ideal low-pass filter. 
—f= dl = probability that a maximum of / selected at random lies between / and / + dl. 

When y is large and positive (3.6-9) is given asymptotically by 

V^n 3 

If we write (3.6-9) as pi(y) dy, the probability density pi(y) of y may be 
plotted as a function of y. This plot is shown in Fig. 2. The distribution 
function P(J m *x < yvVo) defined by 

P(Im«* < yV+o) = f Pi(y)-dy 

J—oa 

and which gives the probability that a maximum selected at random is 
less than a specified y\/^a = I, is one of the four curves plotted in Fig. 4. 
If / is large and positive we may obtain an approximation from (3.6-5). 
We observe that 



(4) 






,"2 



>i 

^0 
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so that when J is large and positive , 

g -.W„/2/2|jl/l ^ g -/W 

Also, in these circumstances the 1 + erf is nearly equal to two. Thus re- 
taining only the important terms and using the definitions of the M's gives 
the approximation to (3.6-5) : 

=H /<T' 2/2 *° (3.6-10) 



dl dt\ -\ 
2mpQ 

From this it follows that the expected number of maxima per second lying 
above the line I = I\ is approximately when I\ is large, 

2tt|_ ^o J (3.6-11) 

_ fi - ; ; /2 ^ x ^[the expected number of zeros of I per second] 

It is interesting to note that the approximation (3.6-11) for the expected 
number of maxima above I\ is the same as the exact expression (3.3-14) for 
the expected number of times I will pass through Ii with positive slope. 

3.7 Results ox the Envelope of the Noise Current 

The noise current flowing in the output of a relatively narrow band pass 
filter has the character of a sine wave of, roughly, the midband frequency 
whose amplitude fluctuates irregularly, the rapidity of fluctuation being 
of the order of the band width. Here we study the fluctuations of the 
envelope of such a wave. 

First we define the envelope. Let /„, be a representative midband fre- 
quency. Then if 

co m = 2irf m (3.7-1) 

the noise current may be represented, see (2.8-6), by 

I = ^ C„ COS (u n t — O m t " tp n + WmO 

«=i (3.7-2) 

= I c cos u m t — I a sin 0) m t 
where the components I c and I a are 

N 
Ic = 2-J C n COS (0)„t — 0> m t — <?„) 



(3.7-3) 



I a = zL c n sin (o) n t — u m t — (p n ) 



33 This expression agrees with an estimate made by V. D. Landon, Proc. I. R. E., 29 
(1941), 50- 55. He discusses the number of crests exceeding four times the r.m.s. value 
of /. This corresponds to I\ = 16^o . 
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The envelope, R, is a function of / denned by 

R = [II + /^] 1/2 (3.7-4) 

It follows from the central limit theorem and the definitions (3.7-3) of I c 
and /., that these are two normally distributed random variables. They are 
independent since IJ a = 0. They both have the same standard deviation, 
namely the square root of 

7! = 7! = 7 = f w{f) d/ = +o (3.7-5) 

Jo 

Consequently, the probability that the point (7 C , I e ) lies within the ele- 
mentary rectangle dl c dl s is 

di c di a r f c + ill .. , . 

^r exp L"^rJ (3 - 7 " 6) 

In much of the following work it is convenient to introduce another ran- 
dom variable 8 where 

I e = R cos 

(3.7-7) 
I s = R sin 6 

Since I c and 7 a are random variables so are R and 0. The differentials are 
related by 

died Is = RdddR (3.7-8) 

and the distribution function for R and 6 is obtainable from (3.7-6) when 
the change of variables is made: 

— RdR £-**!'** (3 7-9) 

Since this may be expressed as a product of terms involving R only and 6 
only, R and 6 are independent random variables, 6 being uniformly dis- 
tributed over the range to 2tt and R having the probability density 34 

£,-*''*■ (3.7-10) 

V'o 

Expression (3.7-10) gives the probability density for the value of the en- 
velope. Like the normal law for the instantaneous value of I, it depends 
only upon the average total power 



*o = [ w(f) df 
Jo 



JO 

See V. D. Landon and K. A. Norton, I.R.E. Proc, 30 (1942), 425-429. 
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We now study the correlation between R at time t and its value at some 
later time / -f- t. Let the subscripts 1 and 2 refer to the times / and / + r, 
respectively. Then from (3.7-3) and the central limit theorem it follows 
that the four random variables I c \ , Li , la , Li have a four dimensional 
normal distribution. This distribution is determined by the second mo- 
ments 

I el = Isl = Ic2 = Is2 = WO = MU 



Li Li = la I a = 
Idlc2 = In 1,2 = o 2 cl cos (w„t - u m r) 

I n=l 



/ w(f) cos 2ir(f — f m )r df = /*i3 
Jo 



(3.7-11) 



I y 

/ciAs = -/ c2 /.i = « 2J ** sin (w„t - W m T) 

Z. n=l 



f «,(/) sin 2tt(/ - / b )t <*/ = nu 
Jo 



M = 





MM 

MM 



The moment matrix for the variables in the order 7 c i , /,i , la , 1,2 is 

/Il3 A*14 

^O — M14 Ml3 

"M14 '/'o 

Ml3 1^0 J 

and from this it follows that the cofactors of the determinant | M | are 
Mn = M«2 = M 3 z = Ma = ypoi^'o — Mi3 — Mm) 

O O 

= \f/ A, A = \po — Mi3 — MM 

M u = M u = 

M13 = Moi = — fJL i3 A 

Mu = —M03 = — nuA 
I M I = -4 2 
The probability density of the four random variables is therefore 

-L exp - A- [*o(/ 2 + J 2 - + 75 + / 2 ) 



(3.7-12) 



- 2mi 3 (/i/ 3 + / 2 / 4 ) - 2mm(/i/4 - hh)\ 
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where we have written Ii,h,h, h for I ci , I sl , I c2 , 7 s2 . We now make 
the transformation 

Ii = Ri cos di I 3 = i? 2 cos 82 

Ii = Ri sin 81 Ii = 7? 2 sin 2 

and average the resulting probability density over 81 and 2 in order to get 
the probability that Ri and i? 2 lie in dRi and dR 2 . It is 

KRid&dRo r 2T ,_ r 2 ' ,. 

**A I d<fl i ^ CXP 

- t-t IhRi + toRl - 2^3 R1R2 cos (0 2 - 1 ) - l^uRiRi sin (0 2 - 8,)} 

Since the integrand is a periodic function of 2 we may integrate from 
82 = 0i to 82 = 8\ -f- 27r instead of from to 2ir. This integration gives the 
Bessel function, I a , of the first kind with imaginary argument. The result- 
ing probability density for i?i and R» is 



R1R2 



A 
where, from (3.7-12), 



h (^~- kg, + M 2 4 ] 1/2 ) exp - £ (R\ + R\) (3.7-13) 



A = \po — /il 3 — nu 



jui3 and /in are given by (3.7-11). Of course, Ri and R 2 are always positive. 
For an ideal band pass filter with cut-offs at/ a and/a we set 

f m = flJ j^, Mf) = a>o for f a <f <f b , 
and obtain 

^0 = iv (fb —fa) 

r/b 

M13 



f o ( t t \ ir «'0 Sin 7T(/ft — fa)T 

= / Wo COS 2tt(/ - / m )r rf/ = ^ ^~ 

Jf a ITT 

r/b 

= J w sin 2tt(/ - fjr df = 



r/b 
Ml* 



'fa 

The 7o term in (3.7-13), which furnishes the correlation between Ri and 7? 2 , 
becomes 

sin x 
R1R2 ~x~ 



__ sin- x 
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where x is ir(/ 6 — /„) t. When * is a multiple of it, Ri and R 2 are independent 
random variables. When x is zero R x and i? 2 are equal. Hence we may 
say, roughly, that the period of fluctuation of R is the time it takes x to in- 
crease from to x or (/& - f a )~\ This is related to the result given in the 
next section, namely that the expected number of maxima of the envelope 
is .641 (f b — fa) per second. 

3.8 Maxima of R 

Here we wish to study the distribution of the maxima of R.* Our work 
is based upon the expression, cf. (3.6-1), 

-dRdt I p(R,0,R")R"dR" (3.8-1) 

for the probability that a maximum of R falls within the elementary rec- 
tangle dR dt. p(R, R', R") is the probability density for the three dimen- 
sional distribution of R, R', R" where the primes denote differentiation with 
respect to /. 

We shall determine p(R, R', R") from the probability density of I c , I s , 
l" c , I t , l' c , l' a ' , which we shall denote by Xi , x 2 , • • • x 6 . The interchange 
of l' a and l' c is suggested by the later work. It is convenient to introduce 
the notation 

». = (wf»(/)(/-/j"* (3iM) 

bo = '/'o 

where f m is the mid-band frequency, i.e., the frequency chosen in the defini- 
tion of the envelope R. b n is seen to be analogous to the derivatives of 
«Kr) at t = 0. 

From the definitions (3.7-3) of I c and I s we obtain the second moments 

x\ = Ic = to = bo 

x A = Is = bo 

x] = 1? = t.w(f n )Afi*(fn ~Uf = b« 
i 

X b = I c = 02 
X* = Ic = 04 



ffl 



- C = 04 



* Incidentally, most of the analysis of this section was originally developed in a study 
of the stability of repeaters in a loaded telephone transmission line. The envelope, R, 
was associated with the "returned current" produced by reflections from line irregularities. 
However, the study fell short of its object and the only results which seemed worth sal- 
vaging at the time were given in reference 23 cited in Section 3.i. 
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XiX 2 



= ids -Z»(A)4/2f(/. ~U) = by 



x\x h = I,I C = —bi 



X\Xi 



= ix = -E^(/)A/4T 2 (/n -uf = -h 



X t X 6 = I t I a = —b-2 

XiXz = Idc = —b 3 

X 5 X 6 = Icla = 63 

All of the other second moments are zero. 



The moment matrix M is thus 







b h -b 2 









bi b 2 -b 3 







M = 


-b 2 -b 3 bi 
bo 



— bi —b 2 






O-61 


b 2 b 3 






O-62 


b 3 bi_ 




The adjoint matrix is 






|~ B Bi -Bo 


"1 






B\ B 22 — B 3 









-B 2 -B 3 Bi 









Bo - 


-Bi —B 2 






-By 


B 22 B 3 






-B 2 


B 3 Bi _ 




B = (b 2 bi - b\)B B 22 = 


(boh - b\)B 


B x = - (M 4 - b 2 b 3 )B B 3 = 


- (bob 3 - bib 2 )B 


B 2 -- 


= 


'bib 3 - bl)B Bi = 


(bob 2 — b ly 


B 



(3.8-3) 

B = bob 2 bi + 2 bib 2 b 3 

— b 2 — bob 3 — bibl 

I M I = B 2 

where B is the determinant of the third order matrices in the upper left and 
lower right corners of M. 

As in the earlier work, the distribution of .vi , • • • , xe is normal in six 
dimensions. The exponent is — [2 | M \ ]~ times 

Bo(#i + Xi) -f- 2Bi(xiX 2 — X4X&) — 2B 2 (xiXz + XiX^) 

+ B 22 (xl + xl) - 2B 3 (x 2 x 3 - x&i) (3.8-4) 

+ Bi(x\ + x\) 
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In line with the earlier work we set 

xi = I e = Rjy& X* — I, = R sin 
X o = l' a = R' sin + R cos 00' 
Xl = f c = R' cosd - R sin 66' 
;V - 3 = /? = R" cos - 2i?' sin 66' 

- R cos 66'- - R sin 00" 
:V6 = f a = R" sin 6 + 2.R' cos 00' 

- R sin 00' 2 + R cos 00" 

The angle varies from to 2w and 0' and 6" vary from - *> to + °o . By 
forming the Jacobian it may be shown that 

dx! dx 2 --- <h* = R 3 dR dR' dR" dd dd' dd" 

Also, the quantities in (3.8-4) are 

x\ + x\ = R 2 *i*3 + *4* 6 = RR" - R'e' 2 

x x x 2 - x iXf> = R 2 6' xl + xl = R' 2 + R 2 6' 2 

x 2 x 3 - x 6 x 6 = RR"6' - 2R' 2 6' - R'Rd" - R 2 d' a 

xl + x\ = R" 2 - 2RR"6' 2 + 4i?' 2 0' 2 + IRR'6'6" 

+ R 2 6 fi 4- R 2 6" 2 

The expression for p(R, 0, R") is obtained when we set these values of the 
x's in (3.8-4) and integrate the resulting probability density over the ranges 
of 0, 0', 6": 

p(R,0,R") = Sul"' dd ( d9 ' ( dQ " (3 ' 8_5) 

exp -_L [BoR 2 + 2B 1 R 2 6' - 2B 2 (RR" - R 2 6' 2 ) 

4- BnR 2 6' 2 - 2B 3 R6'(R" - R6' 2 ) 

+ B,{R" 2 - 2RR"6' 2 4- tf 2 0' 4 4- R 2 6" 2 )] 

The integrations with respect to and 6" may be performed at once leaving 
p(R, 0, R") expressed as a single integral which, unfortunately, appears to 
be difficult to handle. For this reason we assume that w(f) is symmetrical 
about the mid4Dand frequency f m . From (3.8-2), fa and b 3 are zero and 
from (3.8-3), Bi and B 3 are zero. 
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With this assumption (3.8-5) yields 

p(R, 0, R") = R 2 (2ir)" m ^ m [ dd' (3.8-6) 

J— 00 



exp -±[B R 2 + R([B 22 + 2B 2 ]R6' 2 - 2B,R") + B^R" - Rd' 2 ) 2 ] 

The probability that a maximum occurs in the elementary rectangle dR 
dt is, from (3.8-1), p(t, R) dR dt where 

p(t, R) = -f p(R, 0, R")R" dR" (3.8-7) 

J— oo 

We put (3.8-6) in this expression and make the following change of variables. 

R l/2 R l/2 

x = -%L- R8'\ y = — * 12" 

V2 5 ' V2 5 

z = - .l 8 '. £ = -A= R (3.8-8) 

V2-B4 £ -s/2^4 



b = _ (B 22 + 2B 2 ) 
2Bb\ 

2 _ Bo 2Bi _ 60 ^4 

~ 2B*T 2 : J 7T 



3 6 

2 



2b\ J " 2(3 a 



where we have used the expressions for the B's obtained by setting bi and 
b 3 to zero in (3.8-3). Thus 

* {i > R) = A* (rT f y *y f x ~ m dx ( 3 - 8 - 9 > 

b bi \2r/ J o Jo 

exp [-a 2 z 2 + 2bzx + 2zy — (x + y) 2 ] 

As was to be expected, this expression shows that p(t, R) is independent of /. 
A series for p(t, R) may be obtained by expanding exp 2z(y + bx) and 
then integrating termwise. We use 



f' dy r **yr«*' = v£ r (7 + i)r( M + i) 



2^+7+2 

r 



which may be evaluated by setting 



2 2 2-2 

x = p cos ip, y = p sin <p 
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The double integral in (3.8-9) becomes 

-«*«» . A f- (2z) n y- «!&"* r(w + i)r(« - m + 2) 

j/ 2 £{ »! ^ow!(» 



-«)< 2 ^ r /» + 7 



oo n — a 2 « 2 

2 6 



_ ,-6/2 V^ 2 e 

where ^lo = 1 and 

^ = ^ (*)(*) •••0"-*) ((l _ w + 1)6 « < » (3.8-10) 



WI 



/1„ ~ (« + 1)(1 - i)~ 1/2 - ? (1 - by 3 ' 2 , n large 

The term corresponding to m = in (3.8-10) is n -f- 1. 
We thus obtain 

V + l) (3.8-11) 

-a*** ,1/2 co n . 



4-v/tt *o 



- p g + j 



We are interested in the expected number, A 7 , of maxima per second. 
From the similar work for I, it follows that A 7 is the coefficient of dt when 
(3.8-1) is integrated with respect to R from to x . Thus from (3.8-7) and 

dR = Vmbfdz = (2b B) 1,2 bT 3l2 dz 

= [2b (a 2 - \)] m dz 



we find 



N = f p(t, R) 



dR 



(q'-i)7 fcY / 'f r 6 + ^ , (3817) 



e + o r 



Equations (3.8-11) and (3.8-12) have been derived on the assumption 
that «'(/*) is symmetrical about /,„ , i.e. the band pass filter attenuation is 
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symmetrical about the mid-band frequency. We now go a step further and 
assume an ideal band pass filter: 

«,(/) = Wo fa<f <fb 

W (J) = otherwise (3.8-13) 

2/ m =/ +/ b 
Putting these in (3.8-2) we obtain zero for fa and fa and also 

fa = Wo(fb ~ fa) = ^o 

b2= «Lp (fb - fa y 
bi = *p (fb - fa f 



_2 9 



a' = f 

b = W ~ <?) = I 

R = [2fa(a 2 - l)] m z =- [Mo] m z 

91? 



(3.8-14) 



©'"-&]""-'•>• »- 



n A n n A„ 

1 4 6.775 

1 2.3 5 8.333 

2 3.735 6 9.9002 

3 5.238 7 11.4736 
A n ~ 1.5811 11 + .3953 

From (3.8-12) we find that the expected number of maxima per second 
of the envelope is 

N = .64110 (f b - f a ) (3.8-15) 

assuming an ideal band pass filter. 

The distribution of the maxima of R for an ideal band pass filter may be 
obtained by placing the results of (3.8-14) in (3.8-11). This gives 



*«— s^i/!© 



3/2 

-a*** 

e 



1 1 

Wo 

^ z n A, 



''6+8 
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y = 
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= JL- = m 1/2 z 

,1/2 W Z 



r.m.s. /(/) ^ 

where i? is understood to correspond to a maximum of the envelope. Since 
the value of R corresponding to a maximum of the envelope selected at 
random is a random variable, y is also a random variable. Its probability 
density is p R {y), where 

M y) dy = - t& f> dR 
FRK7J y 0.641 10(/ 6 - f a ) 

p R (y) has been computed and is plotted as a function of y in Fig. 3. 




Fig. 3— Distribution of maxima of envelope of noise current. Noise through ideal band- 
pass filter. 

— j= dR = probability that a maximum of R selected at random lies between R and 
R + dR. 

The distribution function P(R max < y\/^o) defined by 

Pn(y) dy 

- 

and which gives the probability that a maximum of the envelope selected 
at random is less than a specified value yV'fo =.R, is plotted in Fig. 4 to- 
gether with other curves of the same nature. 
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When y is large, say greater than 2.5, 



P(R max < y Vfo) 






* (y) ~ muo {y2 " 1)e 



.64110 
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Fig. 4 — Distribution of maxima 
A = P(I < yy/To) = probability of / being less than y VVo • Similarly C = P{R < 

y\/To)- . i— 

B = p(j max < ys/^pa) = probability of random maximum of J being less than yV <Po ■ 
Similarly D = P(R max < yV+o). 
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The asymptotic expression for />r(V) may be obtained from the integral 
(3.8-9) for p(l, R). Indeed, replacing the variables of integration X, y in 
(3.8-9) by 

.v' = .v 

y' = x + y, 

integrating a portion of the y' integral by parts, and assuming b < 1 
(a 2 > 1, by Schwarz's inequality, so that b < 1 always) leads to 



, m (bX*e- R2n *«(R 2 A 



when R is large. 
If, instead of an ideal band pass filter, we assume that w(f) is given by 

w{f) = ^75 g_</ " /m)2/2ff2 > /« » - ( 3 - 8 ~ 16 ) 

we find that 

h= 1 
bi = 4it'(x' 
bi = 16w -ia 
a = 3,b = 
A n = (»+ 1) 

Some rough work indicates that the sum of the series in (3.8-12) is near 
3.97. This gives the expected number of maxima of the envelope as 

iV ='2.52a (3.8-17) 

per second. 

The pass band is determined by a. It appears difficult to compare this 
with an ideal band pass filter. If we use the fact that the filter given by 



w-*«p[-* (HO'] 



passes the same average amount of power as does an ideal band pass filter 
whose pass band is /& — /„ , we have 

ft — fa = <r\f2n 
and the expression for N becomes 1.006 (fb — /„)• 

3.9 Energy Fluctuation 
Some information regarding the statistical behavior of the random vari- 
able 

. E = I' l\t) dt (3.9-1) 
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where /(/) is a noise current and h is chosen at random, has been given in a 
recent article. 35 Here we study this behavior from a somewhat different 
point of view. 

If we agree to use the representations (2.8-1) or (2.8-6) we may write, as 
in the paper, the random variable E as 

E = / f(t) dt (3.9-2) 

J-T/2 

where the randomness on the right is due either to the a„'s and b n 's if (2.8-1) 
is used or to the <p n 's if (2.8-6) is used. 
The average value of E is m T where, from (3.1-2), 



/T/2 _ /.T/2 

P(t) dt = / iKO) dt = T+o 
T/2 J-T/2 

= rfw{f)df 

Ja 



(3.9-3) 



Jo 
The second moment of E is 

p . T/2 ,. T/2 

£ 2 



(3.9-5) 



/T/2 « T/2 

dh I dhP(h)P(h) (3.9-4) 

T/2 J-T/2 

If, for the time being, we set t 2 equal to h + r, it is seen from section 3.2 
that we have an expression for the probability density of 1(h) and I(ti + t) 
and hence we may obtain the required average : 

fill = JL f dh [ " dhllltexp 

("~2T* ( *° 7 ' + * d * " 2 ^ 7l/2) ) 

A 2 = fl - £ , h = 1(h), h = I(h + r) = 1(h) 
The integral may be evaluated by (3.5-6) when we set 

\f/ T = —^0 cos <f> 

A = \po sin <p 

35 "Filtered Thermal Noise— Fluctuation of Energv as a Function of Interval Length", 
Jour. Acous. Soc. Am., 14 (1943), 216-227. 



(3.9-6) 



MATHEMATICAL ANALYSIS OF RANDOM NOISE 89 

Thus 

l\l\ = *i(l + 2 cos 2 ?) 

(3.9-7) 
- il + 2*? 

Incidentally, this gives an expression for the correlation function of I 2 (t). 
Replacing t by its value of U — h and returning to (3.9-4), 

/Tii - r/2 

dh \ dh+\h - h) (3.9-8) 

T/2 J-T/2 

When we introduce <r T , the standard deviation of E, and use 

2 M 2 

ct = E 2 — m T 



we obtain 

. r/2 f r/2 

2 /^, ^\2 ~ J 

' -r/2 J-T/2 



r = (E - E? = 2 [ dh [ dk+\h - h) 

J-T/2 J— T/2 

= 4 [ T (T - x)tf(x) 

Jo 



dx 
j% 

where the second line may be obtained from the first either by changing the 
variables of integration, as in (3.9-27), or by the method used below in 
dealing with E 3 . I am indebted to Prof. Kac for pointing out the advantage 
obtained by reducing the double integral to a single integral. It should be 
noted that the limits of integration — T/2, T/2 in the double integral may 
be replaced by 0, T by making the change of variable t = t' — T/2 for both 
/1 and t 2 . 

When we use 

Ht) = [ w(f) cos 27r/r df (2.1-6) 

we obtain the^result stated in the paper, namely, 

4 = f »(A) df, f w(ji) d h \ *i*h±M (3.9-9) 

Jo Jo L * Ui T h) 

sin 2 7^ -fo)T ~\ 
t 2 (/i-/ 2 ) 2 J 
If this formula is applied to a relatively narrow band-pass filter and if 
T(fb — f a ) >> 1 the contribution of the/i +/ 2 term may be neglected and 
we have the approximation 



2 f At f At sm 7r(/! -f 2 )T 

*t = / wo dfx / w df 2 — y 1 /*' 



= «*r(A-/„) < 3 - 9 - 10 ) 



= WoMt 
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where, from (3.9-3) 

m T = w T(f b - /.) (3.9-11) 

The third moment £ 3 may be computed in the same way. However, in 
this case it pays to introduce the characteristic function for the distribution 
of 1(h), 1(h), 1(h). Since this distribution is normal its characteristic 
function is 
Average exp [iz\l\ + izili + 2*23/3] 

= exp -[^° (21 + z\ + z\) + i(k - h)ziZi ( 3 .9_ 12 ) 

+ +(h - 'i)ziZ3 + Mb - h)Z2Z 3 
From the definition of the characteristic function it follows that 
IUUI = -coeff. of H| in ch. f. 

- +\ + 2^0(^21 + ^31 + *») 
+ 8^-21 ^31 ^32 

where we have written &i for +(h ~ h), etc. When (3.9-13) is multiplied 
by dh dh dh , the variables integrated from to T, and the above double 
integral expression for a T used, we find 

(E - E? = 2!2 2 J dh J dU Jdhfai+nfa ■ 

Denoting the triple integral on the right by / and differentiating, 

1 = 3 f dh f dh+(h - h)HT - h)+(T - hX 
Jo Jo 

= 3 / dx I dy^(x - y)^(x)^(y) 
Ja Jq 



dT 



= 6 / dx f dyyp(x - y)\p(x)\J/(y) 
Jo Jo 



In going from the first line to the second h and h were replaced by T — x and 
T — y, respectively. In going from the second to the third use was made of 
the relations symbolized by 



r-T t-T 



= ( dx [ dy+ [ dy [ dx 
Jo Jo Jo J o 
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and of the fact that the integrand is symmetrical in x and y. Integrating 
dJ/dT with respect to T from to T\, using the formula 

f l dT ff(x) dx = f 1 (2\ - x)f(x) dx, 
Jo Jo Jo 

noting that / is zero when T is zero, and dropping the subscript on Ti finally 
gives 

(E - E) 3 = 48 I dx I dy(T - x)f(x)$(y)$(x - y). 
Jo Jo 

E 4 may be treated in a similar way. It is found that 

(E - £) 4 - 3(£ - E) 22 = 3!2 3 [ dt x \ dt 2 f dh [ dt^ 2i ^ n ^ i2 ^ 

Jo Jo Jo Jo 

which may be reduced to the sum of two triple integrals. It is interesting 
to note that the expression on the left is the fourth semi-invariant of the 
random variable E and gives us a measure of the peakedness of the dis- 
tribution (kurtosis). Likewise, the second and third moments about the 
mean are the second and third semi-invariants of E. This suggests that 
possibly the higher semi-invariants may also be expressed as similar multiple 
integrals. 

So far, in this section, we have been speaking of the statistical constants 
of E. The determination of an exact expression for the probability density 
of E, in which T occurs as a parameter, seems to be quite difficult. 

When T is very small E is approximately I 2 (t)T. The probability that 
E lies in dE is the probability that the current lies in —I, —I —dl plus the 
probability that the current lies in /, I + dl: 

^k, e "P - £ = W° ET r m exp - ^ dE (3.9-14) 

where E is positive, 

/ = (f) /2 ' dI = \{ETr> 2 dE 

and T is assumed to be so small that /(/) does not change appreciably during 
an interval of length T. 

When T is very large we may divide it into a number of intervals, say n, 
each of length T/n. Let E r be the contribution of the r.th interval. The 
energy E for the entire interval is then 

E = E, + E, + • • • + E n 

If the sub-intervals are large enough the E r 's are substantially independent 
random variables. If in addition n is large enough E is distributed nor- 
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mally, approximately. Hence when T is very large the probability that E 
lies in dE is 

dE (E - m T ) n - 
y= exp - r-2 (3.9-15) 



where 



m T = T [ w(f) df 
Jo 

A = T f°w 2 (f)df 

Jo 



(3.9-16) 



the second relation being obtained by letting T — > °o in (3.9-9). The 
analogy with Campbell's theorem, section 1.2, is evident. When we deal 
with a band pass filter we may use (3.9-10) and (3.9-11). 

Consider a relatively narrow band pass filter such that we may find a T 
for which Tf a > > 2tt but T{h -fa) << -64. Thus several cycles of fre- 
quency f a are contained in T but, from (3.8-15), the envelope does not change 
appreciably during this interval. Thus throughout this interval /(/) may 
be considered to be a sine wave of amplitude R. The corresponding value 
of E is approximately 

where the distribution of the envelope R is given by (3.7-10). From this 
it follows that the probability of E lying in dE is 

^ exp - — = — e- BlmT (3.9-17) 

when E is small but not too small. 

When we look at (3.9-14) and (3.9-17) we observe that they are of the 
form 



a n+l E n 
T(n 4- 1) 



.— aE 



dE (3.9-18) 



Moreover, the normal law (3.9-15), may be obtained from this by letting n 
become large. This suggests that an approximate expression for the dis- 
tribution of E is given by (3.9-18) when a and n are selected so as to give 
the values of m T and <x T obtained from (3.9-3) and (3.9-9). This gives 

a = *%, W + l=^f (3.9-19) 

ff T 0T 
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and if we drop the subscript T and substitute the value of a in (3.9-18) we 
get 

(mE\ n 

An idea of how this distribution behaves may be obtained from the 
following table: 



n 


T(f b -fa) 


*.* 


x.u 


X.7S 


X.60 


x.n 

•r.so 








.2') 


.695 


1.39 


.415 


2.00 


1 


1.45 


.96 


1.68 


2.69 


.572 


1.60 


2 


2.4 


1.73 


2.67 


3.94 


.647 


1.47 


3 


3.4 


2.54 


3.67 


5.12 


.692 


1.39 


5 


5.4 


4.22 


5.67 


7.42 


.744 


1.31 


10 


10.5 


8.63 


10.67 


13.02 


.808 


1.22 


24 


25 


21.47 


24.67 


28.17 


.870 


1.14 


48 


50 


44.1 


48.7 


53.5 


.905 


1.10 



where n is the exponent in (3.9-20). The column T(fb — /„) holds only for a 
narrow band pass filter and was obtained by reading the curve y A in Fig. 1 
of the above mentioned paper. The figures in this column are not very 
accurate. The next three columns give the points which divide the dis- 
tribution into four intervals of equal probability: 

tf.26 = — ™ , -E.25 = energy exceeded 75% of time 
x.bo = — y~ , -E.50 = energy exceeded 50% of time 

x.n = — ^- 5 , £.75 = energy exceeded 25% of time 

The values in these columns were obtained from Pearson's table of the in- 
complete gamma function. The last two columns show how the distribu- 
tion clusters around the average value as the normal law is approached. 

For the larger values of n we expected the normal law (3.9-15) to be 
approached. Since, for this law the 25, 50, and 75 per cent points are at 
in — .675a, vi, and m + .675o- we have to a first approximation 

*.BD = % = (n + 1) = T(Jb ~ fa) 

*.a = W , (m - .675a) = x. M - .675\/«7o 

tf.75 = X.M + .675\/z.5o 
This agrees with the table. 
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Thiede 36 has studied the mean square value of the fluctuations of the 
integral 

A {t) = [' l\r)e- a{t - T) dr (3.9-22) 

The reading of a hot wire ammeter through which a current / is passing is 
proportional to A (/) . a is a constant of the meter. Here we study A (/) by 
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PROBABILITY DENSITY 
(3.9-20) IS ASSUMED 
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T(f b -fa) 
Fig. 5*— Filtered thermal noise— spread of energy fluctuation 

d+r 



P{t) dt, h random, / is noise current. 



yi = E.n/E.ba , yi = E.r=/E.ba . 
/ 6 — f a = band width of filter. 

first obtaining its correlation function. This method of approach enables 
us to extend Thiede 's results 

The distributed portion of the power spectrum of A (/) is given by (3.9- 
30). When the power spectrum 10(f) of /(/) is zero except over the band 
f a </<fb where it is w , the power spectrum of ^4(0 is 

2wl(J b - fa - f) f 0<f<fb _ fa 

a 2 + 4tt 2 / 2 

and is zero from/ b - f a up to 2/ a . The spectrum from 2/ a to 2/ 6 is not zero, 
and may be obtained from (3.9-34). The mean square fluctuation of .4(0 
is given, in the general case, by (3.9-28) and (3.9-32). For the band pass 
case, when (f b — fa)/a is large, 

A{t) - A r 



r.m.s. 



.4 



L2(/ 6 -/*)J 



» Elcc. Nadir. Tck., 13 (1936), 84-95. This is an excellent article. 
Note added in proof. The value of y» at should be .415 instead of .403. 
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We start by setting t = t — it which transforms the integral for A(t) into 

A{t) = I I 2 {t - u)e~ au du (3.9-23) 

Jo 

In order to obtain the correlation function ^(t) for A(t) we multiply A{t) 
by .*!(/ + r) and average over all the possible currents 



*(r) = A(t)A(t + r) 

= [ e~ a " du f e~ a " dv ave. f{t - u)l\t + t — v) 
Jo Jo 

Just as in (3.9-4) the average in the integrand is the correlation function of 
/"(/), the argument being / + r — v — t + u = r + u ■ — v. From (3.9-7) 
it is seen that this is 

+1 + 2+\t + u - v) 
where ^(t) is the correlation function of /(/). Hence 

*(r) = -! + 2 f du f dve- au - av tf{ T + u- v) (3.9-24) 
a- Jo Jo 

From the integral (3.9-23) for A(t) it is seen that the average value of 
A(t) is 

A = - = *? (3.9-25) 

a a 

where we have used 

to = *(0) = f w(f) df = P 
Jo 

Using this result again, only this time applying it to A(t), gives 
AHt) = *(0) 

2 r r , (3.9-26) 

= A + 2 / du dv e- au - av tf{u - v) 
Jo Jo 

The double integrals may be transformed by means of the change of 
variable u + v = x, u — v = y. Then (3.9-24) becomes 

■*(t)=A 2 +\J dy J dx + j^ dy j_ dx 1 e~ az yf\ T 4- y) 

\ " " (3.9-27) 

= A* + - f e- ay [f-(r 4- y) + V 2 (r - y)] dy 
a Jq 
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When we make use of the fact that $(y) is an even function of y we see, from 
(3.9-26), that the mean square fluctuation of A(t) is 

(A(t) - A? = TOO - i 2 - ' f e-'tfiy) dy (3.9-28) 

¥(r) may be expressed in terms of integrals involving the power spectrum 
w(f) of /(/). The work starts with (3.9-24) and is much the same as in 
going from (3.9-8) to (3.9-9). The result is 

*( T ) = A' 4- f df x I d/aw(/0w(/a) 
Jo Jo 

[ cos 2tt(/i + h)r cos 2tt(/i - /»)t 1 

La 2 + [2t(/i + / 2 )] 2 a 2 + [2»(/i - /a)] 2 J 

It is convenient to define w(—f) for negative frequencies to be equal to 
w(f). The integration with respect to / 2 may then be taken from — <*> to 
-f- cc and we get 

The power spectrum W(f) of j4(0 may be obtained by integrating ¥(t): 

jjr(y) = 4 / *(t) cos 2tt/t dr 
Jo 

Let us concern ourselves with the fluctuating portion A{t) — A of A{t). 
Its power spectrum W c {f) is 

tf/ c (/) = 4 / (*(t) - A 2 ) cos 2tt/t dr 
Jo 

The integration is simplified by using Fourier's integral formula in the form 
f dr [ df 2 F(f 2 ) cos 2tt(« - f 2 )r = $F(u) 

JO J-«J 

We get 

W.if) = 2 * t« frf/W/iM/+/.)+«'(/iM-/ + /i)] 
= i T7 ra [*"w(fMf-fi)dfi 

a + 47T / J-oo 
The simplicity of this result suggests that a simpler derivation may be 
found. If we attempt to use the result 

w(f) = Limit 2 ASiQl (2.5-3) 



T->ao 



T 
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where S(f) is given by (2.1-2) we find that we need the result 
Limit I f dt x f dl,e 2H/(t2 - ll) I\h)l\k) 

T—co T Jo Jo 



(3.9-31) 

= [ wUi)-w{f-h)dh 



where / > and /(/) is a noise current with w(f) as its power spectrum. 
This may be proved by using (3.9-7) and 

8 / ^ 2 (t) cos 27t/t dr = I w(x)w(f — x) dx 

which is given by equation (4C-6) in Appendix 4C. 

An expression for the mean square fluctuation of A (t) in terms of w(f) may 
be obtained by setting t equal to zero in (3.9-29) 



U(0 -A) 2 = *(0) -A 

r M f +M Af HAM/2) (3.9-32) 

= / d/i / df 2 2 , , 2/ f 77~2 

Jo J-» a + 4tt {fi — fo) 



The same result may be obtained by integrating W c (f), (3.9-30), from 
to oo : 

f ttW C dfMf ^ f - /0 (3 - 9 - 33) 

Although this differs in appearance from (3.9-32) it may be transformed 
into that expression by making use of w(—f) = w(f). 

Suppose that I{t) is the current through an ideal band pass filter so that 
w(f) is zero except in the band/a <f<fb where it is wo . Then, if 3/ a > /& , 

^ = -(/6-/a) (3.9-34) 

a 



/ w{x)w{f — x) dx = \ 



2U'l(f b -fa-f) < / < f b - f a 

wl(f-2f a ) 2/ a </</ 6 +/ a 



[Wl(2f b -f) /6+/a</<2/ 6 

and is zero outside these ranges. The power spectrum W c (f) may be ob- 
tained immediately from (3.9-30) by dividing these values by a 2 + 47r 2 / 2 . 
From (3.9-33) 

ffb ~ fa (ft ~ fa ~ f) 4f 



(A(t) - A) 2 = 2wl [ 
Jo 



a 2 -f- 47T 2 / 2 

'fb+fa If 1/ \ pISb 



J 2f a ot + 4n-7- J fb+fa Or + Air'f 2 
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If an exact answer is desired the integrations may be performed. When we 
assume that/j — /„ <<fb+f a we may obtain approximations for the last 
two integrals. 



^..Sp-/'' -vw«> 



{A{t) - i) 2 = o>o J ± J ~ a tan" 



7To: a 

1 a 2 + 47T 2 (/ ft ~ fa) 2 _ (/> ~ /a) 2 1 

4tt 2 g a 2 "*" a 2 + 4tt 2 (/ 6 + fa)' 2 ] 

Furthermore, if 2ir(fi, — f a )/a is large we have 

u(0 - a? - «*^r 

J.OL 

and the relative r.m.s. fluctuation is 

1/2 



r.m.s. of 



{A{1) - A 



"J L2C/6 -/«)_ 



A 

This result may also be obtained from (3.9-10) and (3.9-11) by assuming 
a so small that the integral for A{t) may be broken into a great many in- 
tegrals each extending over an interval T. aT is assumed so small that 
e~ au is substantially constant over each interval. 

3.10 Distribution or Noise Plus Sine Wave 

Suppose we have a steady sinusoidal current 

I p = I p {t) = P cos (cV - Vp ) (3.10-1) 

We pick times h , h , • • • at random and note the corresponding values of 
the current. How are these values distributed? Picking the times at ran- 
dom in (3.10-1) is the same, statistically, as holding / constant and picking 
the phase angles <p p at random from the range to 2ir. If I P be regarded as 
a random variable defined by the random variable <p p , its characteristic 
function is 

izl 1 / izP cos (u„l—f) d<p 

ave. e " = — / e v 

2tt Jo (3.10-2) 

= MP*) 

and its probability density is 

I 1 (p 2 _ r 2 r 1/2 \T \ < P 
e-*">MPz) dz=\^ Lv) \h\^^ (3.10-3) 

I \I P \> P 

In this case it is simpler to obtain the probability density directly from 
(3.10-1) instead of from the characteristic function. 



2tt jL s 



MATHEMATICAL ANALYSIS OF RANDOM NOISE 99 

Now suppose that we have a noise current 7^ plus a sine wave. By com- 
bining our representation (2.8-6) for I N with the idea of ip p being random 
mentioned above we are led to the representation 

7(0 = I = I P + I N 

= P cos (o) p t — (p p ) + 2 Cn cos (co n t — tpn) t (3.10-4) 
1 

c\ = 2w(f n )Af 

where tp p and <pi , • • • <p i{ are independent random angles. 

If we note 7 at the random times h , k • ■ • how are the observed values 
distributed? Since I p and 7^ may be regarded as independent random 
variables and since the characteristic function for the sum of two such vari- 
ables is the product of their characteristic functions we have from (3.1-6) 
and (3.10-2) 

ave. e*" = ave. e M '> + '*> 

= J (Pz) exp f —|— 1 
which gives the characteristic function of 7. The probability density of 7 

• 37 

IS 

J_ r +W e -i„-(*o*°/2) /o(ft) ^ = — 1 f ,-(/-P cos 9 ) 8 /2* ^ (310 _ 6) 

2ir J-oo TT-y/zinpi) Jo 

In the same way the two-dimensional probability density of (7i , 72), 
where 7i = 7(/) is a sine wave plus noise (3.10-4) and 7 2 = 7(2 + t) is its 
value at a constant interval r later, may be shown to be 



^-^'""jfd.-pf- /i "" 



(3.10-7) 



&? — A *" exp L 2(*F=#5_ 

where 

5(0) = ^ [(/i - ^ cos Bf + (7o - P cos (0 + w p t)) 2 ] 

- 2^ T (7i - P cos 0)(7 2 - P cos (0 + co p t)) 

The characteristic function for 7i and 7 2 is 

ave. e iu ' 1+ivl2 = J (P\/u 2 + v 2 + 2«» cos o> p t) 

(3.10-8) 



X exp — y (« 2 + ^ 2 ) — 'Ar^ 



37 A different derivation of this expression is given by W. R. Bennett, Jour. Aeons. Soc. 
Amor., Vol. 15, p. 165 (Jan. 1944); B.S.T.J., Vol. 23, p. 97 (Jan. 1944). 



100 BELL SYSTEM TECHNICAL JOURNAL 

Sometimes the distribution of the envelope of 

/ = P cos pt + I N (3.10-9) 

is of interest. Here we have replaced u p by p and have set <p p to zero. By 
the envelope we mean R(t) given by 

R\ t ) = R* = ( P + I c f + f a (3.10-10) 

where I c is the component of I N "in phase" with cos pt and I s is the com- 
ponent "in phase" with sin pt: 

Ie = J2c n COS [(u n ~ p)t — <Pn] 

Is = 2 c n sin [(w„ — p)t — cp n ] 
In = Ic cos pt — I a sin pt 

~7* "/2 7^ / 

Since J c and 7 S are distributed normally about zero with a variance of 
^o , the probability densities of the variables 

X= P + Ic 



are 



(2mPo)- m exp - ( * ~ P) '' 



Wo)- 1 ' 2 exp - £- 



2fa 

2 



respectively. Setting 



x = R cos 

y = R sin 6 
and using these distributions shows that the probability of a point (x, y) 
lying in the ring R, R + dR is 

*^ f V exp ["--L (tf 2 + P 2 - 2i?P cos 0)1 <*0 
27T^ Jo L 2 ^o J 

= ^- exp L"^o-J /o U; (3 - 10_11) 

where h is the Bessel function with imaginary argument. 

oo In 
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and is a tabulated function. Thus (3.10-11) gives the probability density 
of the envelope R. 

The average value of R" may be obtained by multiplying (3.10-11) by R" 
and integrating from flto x. Expansion of the Bessel function and term- 
wise integration gives 

= (2f.rrg + l) I F 1 (-|;l;-£) (3.KM2) 

where 1F1 is a hypergeometric function. 38 In going from the first line to 
the second we have used Kummer's first transformation of this function. 
A special case is 

R? - P 2 + 2^o (3.10-13) 

When only noise is present, P = and 



1/2 
1/2 • 



I - ONTrfB - (*) (310 . 14) 

R 2 = 2^o 

Before going further with (3.10-11) it is convenient to make the following 
change of notation 

» - 7175 > dv = Jm> a " 7175 (3.10-15) 

Wo Vo Wo 

"a" is the ratio (sine wave amplitude)/(r.m.s. noise current). 

Instead of the random variable R we now have the random variable v whose 

probability density is 



[-'-¥}- 



p(v) = v exp -— i— J /o(at») (3.10-16) 

Curves of p(v) versus v are plotted in Fig. 6 for the values 0, 1, 2, 3, 5 of a . 
Curves showing the probability that v is less than a stated amount, i.e., dis- 
tribution curves for v, are given in Fig. 7. These curves were obtained by 
integrating p(v) numerically. The following useful expression for this 
probability has been given by W. R. Bennett in some unpublished work. 

£ p(u) du = exp [-^4^1 S 0" In(aV) (3 - 10 ~ 17) 

38 Curves of this function are given in "Tables of Functions", Jahnke and Emde (1938), 
p. 275, and some of its properties are stated in Appendix 4C. 
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This is obtained by integration by parts using 

f u n I n -i(au) du = ul n (au)/a 

When av >> 1 but 1 « a — v, Bennett has shown that (3.10-17) 
leads to 



f^ter.4-,4-^'] 



1 - 



3(g + vf - 4a 2 
8av(a — v) 2 



(3.10-18) 
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Fig. 6 — Probability density of envelope R of /(/) = P cos pi + I N 

This formula may also be obtained by putting the asymptotic expansion 
(3.10-19) for p(v) in (3.10-17), integrating by parts twice, and -neglecting 
higher order terms. 

When av becomes large we may replace h(av) by its asymptotic expres- 
sion. The expression for p(v) is then 

Thus when either a becomes large or v is far out on the tail of the probability 
density curve, the distribution behaves like a normal law. In terms of the 
original quantities, the normal law has an average of P and a standard devia- 
tion of \pl 12 . This standard deviation is the same as the standard deviation 
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of the instantaneous values of I N . When av » 1 and a 2> | v — a [ we may 
expand the coefficient of the exponential term in (3.10-19) in powers of 
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Fig. 7 — Distribution function of envelope R of /(/) = P cos pi + /. v 

(v — a)/ a. Integrating this expansion termwise gives, when terms of magni- 
tude less than a~ 3 are neglected, 

r v 1 1 v — a 

J o p(ii) dtt « - + - erf ~^yY 

1 " v — a 1 + ( v — a) 2 "] T (v — a) 2 ~\ 

- ws } - it + ~ i? - -J ex p L - ~i~~ J 
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When / consists of two sine waves plus noise 

/ = P cos pt + Q sin qt + I N , (3. 10-20) 

where the radian frequencies p and q are incommensurable, the probability 
density of the envelope R is 

R f rJ (Rr)MPr)MQr)e-+ or2 ' 2 dr . (3.10-21) 

Jo 

where \po is 1% . When Q is zero the integral may be evaluated to give 
(3.10-11). When both P and Q are zero the probability density for R 
when only noise is present is obtained. If there are three sine waves instead 
of two then another Bessel function must be placed in the integrand, and 
so on. To define R it is convenient to think of the noise as being confined 
to a relatively narrow band and the frequencies of the sine waves lying 
within, or close to, this band. As in equations (3.7-2) to (3.7-4), we refer 
all terms to a representative mid-band frequency /„» = oi m /2ir by using 
equations of the type 

cos pt = cos [(p — u m )l -\- ca m t] 

= cos (p — a) m )t cos o) m t — sin (p — o> m )t sin <a m t. 

In this way we obtain 

V = A cos taj - B sin <aj = R cos (a J + 6) (3.10-22) 

where A and B are relatively slowly varying functions of t given by 

A = P cos (p — w»)/ + Q cos (q — w»)* 

+ 23 c„ cos (co„ I — 0) m t — <p n ) 



B = P sin (p — o) m )t + Q sin (q — a^)t 

+ 2 Cn sin (o)„ t — o) m t — <p„) 

n 

and 

E 2 = A 2 + B\ R > 
tan = B/A 



(3.10-23) 



(3.10-24) 



As might be expected, (3.10-21) is closely associated with the problem 
of random flights and may be obtained from Kluyver's result 39 by assuming 

39 G. N. Watson, "Theory of Bessel Functions" (Cambridge, 1922), p. 420. 
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the noise to correspond to a very large number of very small random dis- 
placements. 

Another way of deriving (3.10-21) is to assume (p - Um )t, (q — Wm )/, 
<Pi , <p2 , ■ • • [are independent random angles. The characteristic function 
of A, B is 

ave. e iuA+ivB = MPV^f^MQV^l^e- 1 * '^*^ 
The probability density of A, B is 

QT [ + J du [ +X dv e -*"--"« ave. e iuA+ivB 

When the change of variables 

A = R cos 6 u = r cos <p 

B = i? sin v = r sin <p 

is made the integration with respect to <p may be performed. The double 
integral becomes 

~ [ rUPr)J Q {Qr)URr)e- {,pomT2 dr 

This leads directly to (3.10-21) when we observe that dAdB = RdRdd. 
Incidentally, if 

I = Q(l + k cos pt) cos qt + /* 

in which p << q, similar considerations show that the probability density 
of R is 

jL[ dal rJ (Rr)J [Qr(l + k cos a)]<T ((( ' o/2)r2 dr 

Z7T JO JO 

when w m is taken to be q. The integration with respect to r may be per- 
formed. This relation is closely connected with (3.10-11). 

Returning now to the case in which / is the sum of two sine waves plus 
noise, we may show from (3.10-21) and 



/ R n+1 J (Rr)dR = 



,n+l 



2"^ r 



o+a 



-i / ? [\ 



r" T T 



\ 2, 
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that the average value of R n is, when — 2 < re (n) < — |, 

2 " +,r H) f v-.. 



R n = 



[ T-*- l MPr)MQr)<r*" t,% * 

H) ° 



\Z I *=0 m=0 



(-»)*(-*)" (3-10-25) 

fc-l-m 



&!A!w! w! 



. ( „.. r (, + ,)it%^,^) 

It appears very probable that this result could be extended, by analytic 
continuation, to positive integer values of n. We have used the notation 

(«)o = 1, (a)* - «(« + 1) • • ■ (« + * - 1) 



P 2 



^ (3.10-26) 

* = 2^0 ' y = 27o 

and have denoted the Legendre polynomial by P k (z). The series converge 
for all values of P, Q, and ifa and terminate when « is an even positive integer. 
When re or y, or both, are large in Comparison with unity we may use the 
integral for R? to obtain the asymptotic expansion, assuming Q < P so 
that y < x, 

n\ / n 



g~^S ^ V l ('-2'*-S il8 S) (3 - 10 " 27) 

When n is an even positive integer this series terminates and gives the same 
expression as (3.10-25). When n is an odd integer the 2 ^i may be expressed 
in terms of the complete elliptic functions E and K of modulus y x : 

J>,(n!li')-|l 

The higher terms may be computed from 

a(l - s)Vi(« + 1, a + 1; l;s) = (2a - 1)(1 + stfifa a; 1;*) 

+ (1 - a)J?i(o - 1, a - 1; l;s) (3.10-29) 
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which is a special case of 

ab(y + 1)(1 .- z? 2 Fi(a + 1, b + 1; c; s) = A tfifo b; c; z) 

- (y- Dic-aXc-fyoF^a- l,b-l;c;z) (3.10-30) 

where y = c — a — b and 

A = (y 2 - 1) 7 + (1 - z)[(y - \){c - b){b - 1) + (y + l)a(c - a - 1)] 

Although this expression does not show it, A is really symmetrical in a 
and b. A symmetrical form may be obtained by using the expression ob- 
tained by putting s = in (3.10-30). 

3.11 Shot Effect Representation 

In most of the work in this part the representations (2.8-1) or (2.8-6) 
have been used as a starting point. Here we point out that the shot effect 
representation used in Part I may also be used as a starting point. 

For example, suppose we wish to find the two dimensional distribution of 
/(/) and /(/ + r) discussed in Section 3.2. This is a special case of the distri- 
bution of the two variables 



(3.11-1) 



Kt) - Z Fit - h) 

k=—ao 
+» 

J(t) = Egc- /*) 

*=-oo 

where we now assume 

[ F(t) dt ! = f G(t) dt = (3.11-2) 

J — CO •" — CO 

in order that the average values of / and J may be zero. In fact, to get 
/(/ + t) from /(/) we set G{t) equal to F{t + r). 

The distribution of / and / may be obtained in much the same manner 
as was the distribution of / alone in section 1.4. The characteristic func- 
tion of the distribution is 



/(**, v) = ave. e 

= exp v f [«*■*«-"■«« - 1] 

•/-co 



r i„*<£\-i-lmClft\ .-, ,, (3.11 3) 

at 



where v is the expected number of events (electron arrivals in the shot effect) 
per second. The probability density of / and / is 

i is du i r dv e ~ u "~ ivj rt u > v) ( sa ^ 
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The semi-invariants X m ,„ are given by the generating function 

log/(«, t) - t, ^ri WW + o[{iu)\ iivf] 
m ,n=i mini 

and are 

X m .„ = v [ +X F m (t)G n (t) dt (3.11-5) 

J— 00 

As v — » oo the distribution of / and / approaches a two dimensional normal 
law. The approximation to this normal law may be obtained in much the 
same manner as in section 1.6. From our assumption (3.11-2) it follows 
that Xio and Xoi are zero. From the relation between the second moments 
and semi-invariants X we have 



/in = X 20 + X?o = v I F*{t) dt 

J— 00 

M12 = Xn + X 10 Xoi = v [ F(t)G(t) dt (3.11-6) 

J— 00 

f+00 
G'{t) dt 
00 

where the notation in the subscripts of the fi's differs from that of the X's, 
the change being made to bring it in line with sections 2.9 and 2.10 so that 
we may write down the normal distribution at once. 

The formulas (3.11-6) are closely related to Rowland's generalization of 
Campbell's theorem mentioned just below equation (1.5-9). 



PART IV 
NOISE THROUGH NON-LINEAR DEVICES 

4.0 Introduction 

We shall consider two problems which concern noise passing through 
detectors or other non-linear devices. The first deals with the statistical 
properties of the output of a non-linear device, that is, with its average 
value, its fluctuation about this average and so on. The second problem 
may be stated more definitely: Given a non-linear device and an input 
consisting of noise alone, or of noise plus a signal. What is the power 
spectrum of the output? 

There does not seem to be much published material on the first problem. 
However, from conversation with other people, I have learned that it has 
been studied independently by several investigators. The same is probably 
true of the second problem although here the published material is somewhat 
more plentiful. This makes, it difficult to assign credit where credit is due. 
Much of the material given here had its origin in discussions with friends, 
especially with W. R. Bennett, J. H. Van Vleck, and David Middleton. 
Help was obtained from the recent paper 37 by Bennett, and also from the 
manuscript of a forthcoming paper by Middleton. 

4.1 Low Frequency Output of a Square Law Device 

Let the output current / of the device be related to the input voltage V by 

/ = aV 2 (4.1-1) 

where a is a constant. When the power spectrum of V is confined to a 
relatively narrow band, the power spectrum of / consists of two portions. 
One portion clusters around twice the mid-band frequency of V and the 
other around zero frequency. We are interested in the low frequency 
portion. The current corresponding to this portion will be denoted by 
1,1 , and is the current which would flow if a low pass filter were inserted 
in the output to remove the upper portion of the spectrum. It is convenient 
to divide Id into two components: 

la = lie + in (4.1-2) 

37 Loc. cit. (Section 3.10). 

40 Cruft Laboratory and the Research Laboratory of Physics, Harvard University, 
Cambridge, Mass. In the following sections references to Bennett's paper and Middle- 
ton's manuscript are made by simply giving the authors' names. 
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where the subscripts stand for "total low" frequency, "direct current." 
and "low frequency," respective!}'. We have 

he = average Id = lit. (4.1-3) 

Mean Square If/ = average (I d — he) = l)( — he 

Probably the simplest method of obtaining h c is to square the given ex- 
pression for V and pick out the terms independent of time. Thus if 

V = P cos pt -f- Q cos qt +V„ (4.1-4) 
we have 

he = Q! ( : y + |" + ^) (4- 1 - 5 ) 

I If may also be obtained by picking out the low frequency terms. How- 
ever, here we wish to use the square law device, and the linear rectifier in the 
next section, to illustrate a general method of dealing with the statistical 
properties of the output of a non-linear device when the input voltage is 
restricted to a relatively narrow band. 

If none of the low frequency spectrum is removed by filters, 

/rf B «y (4.1-6) 

where R is the envelope of V. The probability density and the statistical 
properties of I,c may be derived from this relation when the distribution 
function cf R is known. Before discussing these properties we shall 
establish (4.1-6). 

Equation (4.1-6) is a special case of a more general result established 
in Section 4.3. However, its truth may be seen by taking the example 

V = P cos pt + Q cos qt + V K (4.1-4) 

where / p = pjl-w and/, = q/2ir lie within, or close to, the band of the noise 
voltage Vjr . 

By using formulas of the type 

cos pt = cos [(* — co m )t + w ra l] 

(4.1-7) 
= cos (p — o) m )t cos u m t — sin (p — co m )t sin o) m t 

41 When part of the low-frequency spectrum is removed, the problem becomes much 
more difficult. Id C may be obtained as above, but to get ftj it is necessary to first deter- 
mine the power spectrum of / (Section 4.5) and then integrate over the appropriate por- 
tion of it. Concerning the distribution of Iff , our present knowledge tells us only that it 
lies between the one given by (4. 1-6) and the normal law which it approaches when only 
a narrow portion of the low frequency spectrum is passed by the audio frequency filter 
(Section 4.3). 
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we may refer all terms to the mid-band frequency f m = «m/27r, as is done 
in equations (3.7-2) to (3.7-4). 
In this way we obtain 

V = A cos uj - B sin coj = R cos (o>J + 0), (4.1-8) 

where A and B are relatively slowly varying functions of / given by 

A = P cos (p — u m )t + Q cos (q — u m )t + zL c n cos (uj — u m t — <p n ), 

B = P sin (p — u m )t + Q sin (q — u> m )t + ^2 c n sin («„/ — co m / — <?„) 

n 

and 

i? 2 = .4 2 + B 2 , R > 

(4.1-9) 
tan = B/ii. 

This definition of R has also been given in equations (3.10-22, 23, 24). 
The envelope of V is R and the output current is 

I = aR 2 |i 4- 1 cos (2u m * + 20)1 (4.1-10) 



Since i? is a slowly varying function of time, so is i? . The power spectrum 
of R 2 is confined to frequencies much lower than 2/„, and consequently the 
power spectrum of R 2 cos (2o> ni / 4- 20) is clustered around 2/„, . Thus the 
only term in / contributing to the low frequency output is aR~/2 which is 
what we wished to show. 

We now return to the statistical properties of Id . First, consider the 
case in which V consists of noise only, V = V N , so that the probability 
density of the envelope R is 

- e-**' 2 * (3.7-10) 

to 



where 
Hence 



fa = [rms Vs? = Vl (4.1-11) 



7 aR2 

he = la— -y 



Jo 2 vi'o 



aR' R - R ».,? 
= cabo 



Hi 



— 2 f" a 

= I-H - I- dc = I - 4 



R° _-*> 



I"-U 



-m-KW dR _ j 



4 ^° (4.1-12) 



2 i2 



= a ^o 
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Second, consider the case in which 

V = V N + P cos pt (4.1-13) 

where p/2ir lies near the noise band of Vn . The probability density of the 
envelope R is 

From this and equations (3.10-12), (3.10-13), we find 

Tdc =°f = o^o + °f (4.1-14) 

7} f =7 l( - lie = c?[+o + P*]fo (4.1-15) 

In (4.1-14) ^o is the mean square value of V N and P 2 /2 is the mean 
square value of the signal. These two equations show that Idc and the 
rms value of Iy are independent of the distribution of the noise power 
spectrum in V N as long as the input V is confined to a relatively narrow band. 
In other words, although this distribution does affect the power spectrum 
of the output, it does not affect the d.c. and rms Iff when ^oand P are given. 
That the same is also true for a large class of non-linear devices was first 
pointed out by.Middleton (see end of Section 4.9). 

When the voltage is 42 

V = Vj, + P cos pt + Q cos qt, (4.1-4) 

p t± q, we obtain from equation (3.10-25) 

Wl-i-R* (4.1-16) 

4 

42 These results are special cases, obtained bv assuming no audio frequency filter, of 
formulas given by F. C. Williams, Jour. Inst, of E. E., 80 (1937), 218-226. Williams also 
discusses the response of a linear rectifier to (4.1-4) when ?3>Q+ Vy . An account 
of Williams' work is given by E. B. Moullin, "Spontaneous Fluctuations of Voltage," 
Oxford (1938), Chap. 7. 
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4.2 Low Frequency Output of a Linear Rectifier 
In the case of the linear rectifier 

f 0, V < 
/ = \ (4.2-1) 

[aV, V > 

the low frequency output current, assuming no audio frequency filter, is 

U = =* (4.2-2) 

This formula, like its analogue (4.1-6) for the square law device, assumes 
that the applied signal and noise lie within a relatively narrow band. It 
may be used to compute the probability density and statistical properties 
of I u when the corresponding information regarding the envelope R of the 
applied voltage is known. 

The truth of (4.2-2) may be seen by considering the output I. It con- 
sists of the positive halves of the oscillations of aV. The envelope of 1 is 
the same as that of aV. However, the area under the loops of 7 is only about 
l/v of the area under aR, this being the ratio of the area under a loop of 
sin x to the area of a rectangle of unit height and length 27r. From the 
low frequency point of view these loops of I merge into a current which 
varies as aR/ir. 

When V is a sine wave plus noise, 

V = V s + P cos pt (4.1-13) 

the average value of 7, /is 43 

-.(£)">■[<, + .».(f) + ..,(f 



where h , I\ are Bessel functions of imaginary argument and 

P" _ ave. sine wave power 



x = 



2^o ave. noise power 



(4.2-4) 



43 This result was discovered independently by several investigators, among whom we 
may mention VV. R. Bennett and D. O. North. The latter has applied it to noise measure- 
ment work. He has found that the diode detector, when adapted to noise metering, is a 
great improvement over the thermocouple, and has used noise meters of this type satis- 
factorily since 1940. See D. O. North, "The Modification of Noise by Certain Non- 
Linear Devices", Paper read before I.R.E., Jan. 28, 1944. 
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fa being the average value of V 2 „ . Equation (4.2-3) follows from the 
formulas (3.10-12) and (4B-9). When * is large the asymptotic expansion 
(4B-3) of the X F X gives 

r. „ « \p + +1 + $L + . . .1 (4.2-5) 

ldc ttL 2-P 8^* J 

Similarly, the mean square value of 1 1 ( is 

Jf e = *! j? = -£l! (P 2 + 2^o) (4.2-6) 

7T" 71" 

and the mean square value of the low frequency current Its , excluding the 
d.c, is given by 

it/ = fa - tic 

When x is large we have 
and when x = 0, 



'<' = IH 2_ D (4 - 2_8) 

Curves for ldc are given in Figures 1^2 and 3 of Bennett's paper. He 
also gives curves, in Fig. 4, showing l\ { versus x. These show that the 
effect of the higher order modulation terms is small when Its is computed 
by adding low frequency modulation products. 

When V consists of two sine waves plus noise, 

V = V N + P cos pt + Q cos qt, (4.1-4) 

the average value of Id is, from (3.10-25), a sort of double iZ 7 ! function: 



I dc = - R = a (PT £ £ r,#f", ("*)*( -^ 
dc ir \2irJ m SA klklmlml 



(4.2-9) 



where 



x = EL y —^- pJz) = Legendre polynomial (4.2-10) 

2<Ao' ^2^o 

If x is large and y < x, we have from (3.10-27) the asymptotic expression 
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The 2^1 may be expressed in terms of the complete elliptic functions E and 
K of modulus y 1 2 x~ l 2 . Thus 



■*(-fc-*»^-**-i(i-S)* 

*(fc»,i,|)-|x 



(3.1C-28) 



and the higher terms may be computed from the recurrence relation 
(3.10-29). The first term, k = 0, in (4.2-11) gives I dc when the noise is 



absent. 44 



The mean square value of Id is 

lf e = °L R2 = " [2^ 4- P 2 4- Q 2 ] (4.2-14) 



7T- ir- 



From this expression and our expression for I dc , the rms value of the low 
frequency current, If/ , excluding the d.c, may be computed. For example, 
when the noise is small, 



ib ~ j [p 2 + Q 2 - (p*f 1 (-h -hU y - 



+*(i-*(-fc-toi,|)f)] 



(4.2-15) 



The term independent of ^o gives the mean square low frequency current 
in the absence of noise. As Q goes to zero (4.2-15) approaches the leading 
term in (4.2-7), as it should. AYhen P = Q our formula breaks down and 
it appears that we need the asymptotic behavior of 45 



M 1/2 \^ (-4M2*)i 



In view of the questionable nature of the derivation given in Section 3.10 
of equations (4.2-9) and (4.2-11) it was thought that a numerical check on 
their equivalence would be worth while. Accordingly, the values x = 4, 
y = 3 were used in the second series of (4.2-9). It was found that the 
largest term (about 130) in the summation occurred at k = 11. In all, 24 
terms were taken. The result obtained was 

/: = 2.5502 



V2^ 



« See W. R. Bennett, B.S.T.J., Vol. 12 (1933), 228-243. 

45 This may be done by the method given by W. B. Ford, Asymptotic Developments, 
Univ. of Mich. Press (1936), Chap. VI. 
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For the same values of x and y the asymptotic series (4.2-11) gave 

2.40 + 0.171 + .075 + 0.52 + •••• 

If we stop just before the smallest term we get 2.57 for the sum. If we 
include the smallest term we get 2.65. This agreement indicates that 
(4.2-11) is actually the asymptotic expansion of (4.2-9). 
When the voltage is of the form 

V = Q(l + k cos ft) cos qt + Vff 
we may use 

^ = (2^rr(i + ^)i.r 

V 2/ 2 " * (4.2-16) 

iFi[-|;i;-y(l 4-£cos0) 2 ]<# 

where R is the envelope with respect to the frequency q/2ir and y is given 
by (4.2-10). The integral may be evaluated by writing 1F1 as a power 
series and integrating termwise using the result 

1 r 2 * 
— / (1 + & cos 0)' cos mOdd 

2irJ ° (4.2-17) 

(-() m , M « « [tn - I m - 1+ 1 . , 1 . , 2 1 

where w is a non-negative integer, f any number, 

(a) m = a(a + 1) • • • (a + m - 1), (a)o = 1, and (0)o = 1. 

The integral may also be evaluated in terms of the associated Legendre 
function. 

By applying the methods of Section 3.10 to (4.2-16) we are led to 

jf-<?(i + £) + ** 

^ 7 (4.2-18) 

* $3, sly 

where the asymptotic series holds when y is very large and k is not too close 
to unity. These expressions give 

f (I ~ |? ((? \ + *o[2 - (1 - ^ 2 )- 1/2 ] + • • •) (4.2-19) 
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The reader might be tempted to associate the coefficient of ^o in (4.2-19) 
with the continuous portion of the output power spectrum. However, this 
would not be correct. It appears that the principal contribution of the 
continuous portion of the power spectrum to /// is a \{/o/ir , just as in (4.2-7) 
when k is zero. The difference between this and the corresponding term 
in (4.2-19) seems to arise from the fact that the amplitude of the recovered 
signal is not exactly aQk/ir but is modified by the presence of the noise. 
This general type of behavior might be expected on physical grounds since 
changing P, say doubling it, in (4.2-7) does not appreciably affect the i}/ 
in (4.2-7) (which is due entirely to the continuous portion of the noise 
spectrum). The modulating wave may be regarded as slowly making 
changes of this sort in P. 

4.3 Some Statistical Properties of the Output or a General 
Non-Linear Device 

Our general problem is this : Given a non-linear device whose output / is 
related to its input V by the relation 

1 = T- ( F(iu)e iVu du (4A-1) 

which is discussed in Appendix 4A. Let the input V contain noise in addi- 
tion to the signal. Choose some frequency band in the output for study. 
What are the statistical properties of the current flowing in this band? 

It seems to be difficult to handle this general problem. However, it 
appears that the two following results are true. 

1. As the output band is chosen narrower and narrower the statistical 
properties of the corresponding current approach those of the random noise 
current discussed in Part III (provided no signal harmonic lies within the 
band). In particular, the instantaneous current values are distributed 
normally. 

2. When the input V is confined to a relatively narrow band the power 
spectrum of the output I is clustered around the th (d.c), 1st, 2nd, etc. 
harmonics of the midband frequency of V. The low frequency output in- 
cluding the d.c. is 

Id = A (R) = J- / F(iu)MuR) du (4.3-11) 

Zir J c 

where R is the envelope of V. 

The envelope of the nth harmonic of the output, when n > 0, is 

A n (R) = - [ F(iu)J n (uR) du (4.3-1) 

7T Jc 



118 BELL SYSTEM TECHNICAL JOURNAL 

The mathematical statement is 

/ = £ MR) cos (nu>mt + nd) (4.3-9) 

n=0 

where f m = co m /(2x) is the representative mid-band frequency of V and 
is a relatively slowly varying phase angle. The results of Sections 4.1 
and 4.2 are special cases of this. 

Middletoh's result that the noise power in each of the output bands (in 
the entire band corresponding to a given harmonic) depends only on V N = 
^o and not on the spectrum of V N , where V N is the noise voltage component 
of V, may also be obtained from (4.3-9). We note that the total power 
in the n th band depends only on the mean square value of its envelope 
A„(R), and that the probability density of the envelope R of the input in- 
volves V N only through t^o . 

The argument we shall use in discussing the first result is not very satis- 
factory. It runs as follows. The output current J may be divided into two 
parts. One consists of sinusoidal terms due to the signal. The other con- 
sists of noise. We shall be concerned only with the latter which we shall 
call In . The correlation between two values of In separated by an interval 
of time approaches zero as the interval becomes large. Let t be an interval 
long enough to ensure that the two values of In are substantially 
independent. Choose an interval of time T long enough to contain many 
intervals of length t. Expand In as a Fourier series over this interval. 
We have 

In = ~ + 2^ M 1 " C0S ~^- + bn Sin ~^F~ 

2 "= lL T T J (4.3-2) 

T 



■ >a n -ib n =l( e- i2 * nl,T lN(t) dt 
1 Jo 

Let the. band chosen for study be/o — - to/ + -z and let 

r(/o-f) = *i> r(/o + f)=*2 (4.3-3) 

where m and n 2 are integers. The number of components in the band is 
(„ 2 _ Wl ), We suppose /3 is such that this is small in comparison with T/t. 
The output of the band is 



Jn = 



2 a n cos — / + b n sin — j (4.3-4) 
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where 



a n - ibn = % f e- i * rllnm -" u e- i *"° t IMdt 
T Jo 

w = — - — + n - — - — = /o T + (» - /o i) 



(4.3-5) 



We choose the band so narrow that 

n 2 - n x « T/t or (3t « 1 (4.3-6) 

This enables us to write approximately 

a n - ib n = £ 6 - i2 ' ((B/T) - /0)rT | /" T e**'"!*® dt 

r=l -t J (r-1)T 

n = r/r, r being chosen to make n an integer. Suppose we do this for 
a large number of intervals of length T. Then I N {t) will differ from interval 
to interval. The set of integrals for r = 1 gives us an array of values which 
we regard as denning the distribution of a complex random variable, say 
xi . Similarly the set of integrals f or r = 2 defines the distribution of a 
second random variable .r 2 , and so on to x u . Because we have chosen r 
so large that I K (t) in any one integral is practically independent of its values 
in the other integrals we may say that x\ , x 2 , ■ ■ • x Tl are independent. 

We have 

Ah V / ,-»2»((n/T)-/o)M- „ 

T=l 

r=l 

Ah — V^ -«"2!r((n 2 /r)-/o)rT 
flno — Wno — 2-J e Xr 

t=l 

and if « 2 — "i « r\ , as was assumed in (4.3-6), we may apply the central 
limit theorem to show that <z„, ,. 6„, , fl„ 1+ i , • • • a n „ , b„„ tend to become in- 
dependent and normally distributed about zero as we let the band width 
/3 — > and T —> « (and hence r x — » w ) in such a way as to keep m — ih 
fixed. In this work we make use of the fact that I N {t) is such that the real 
and imaginary parts of Xi, .v 2 , • • • x r all have the same average and standard 
deviation. It is convenient to assume foT is an integer. 

Thus as the band width /3 approaches zero the band output J N given by 
(4.3-4) may be represented in the same way, namely as (2.8-1), as was the 
random noise current studied in Part III. Hence J N tends to have the 
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same properties as the random noise current studied there. For example, 
the distribution of J N tends towards a normal law. In our discussion we 
had to assume that 0t <C 1. If the voltage V applied to the non-linear 
device is confined to a relatively narrow frequency band, say fb — fa, it 
appears that the interval r (chosen above so that I(t) and /(/ + r) are sub- 
stantially independent) may be taken to be of the order of l/(/b — fa)- 
In this case J N tends to behave like a random noise current if /3/(/& ~~ fa) is 
much smaller than unity. 

We now turn our attention to the second statement made at the begin- 
ning of this section. Let the applied voltage be confined to a relatively 
narrow band so that it may be represented by equation (4.1-8) of Section 
4.1, 

V = R cos (a J + 6), R > 0, (4.1-8) 

where /,„ = o) m /(2w) is some representative frequency within the band 
and R and 6 are functions of time which vary slowly in comparison with 
cos u m t. We call R the envelope of V. 
From equation (4A-1) 

/ = _L ( F(iu)e iuRcoB l ° nt+e) du (4.3-7) 

2t J c 

We expand the integrand by means of 

g iX cos , = £ e jn cos n<pJn ( x ) ( 4>3 _ 8 ) 

71 = 

where €o is 1 and e„ is 2 when n > and J n (x) is a Bessel function. 
Thus 

oo 

I = E MR) cos (na m t + nd) (4.3-9) 

n=0 

where 

A n (R) = e n £ f F(iu)J n {uR) du (4.3-10) 

It Jc 

Since R is a relatively slowly varying function of time we expect the 
same to be true of A„(R), at least for moderately small values of n. Thus 
from (4.3-9) we see that the power spectrum of / will consist of a suc- 
cession of bands, the n th band being clustered around the frequency nf m . 
If we eliminate all of the bands except the n tb by means of a filter we 
see that the output will have the envelope A n (R) when n ^ 1. Taking 
n to be zero, shows that the low frequency output is simply 

A (R) = J- [ F(iu)J (uR) du (4.3-11) 

Z7T Jc 
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Taking n to be one shows that the band around /,„ is given by 

Ai(R) 



R 



V (4.3-12) 



The statistical properties of the low frequency output and of the en- 
velopes of the output bands may be obtained from those of R. For ex- 
ample, the probability density of A„(R) is of the form 



**/% 



(R) (4.3-13) 



dR 

where p(R) is the probability density of R. In this expression R is con- 
sidered as a function of A„ . 

It should be noted that we have been assuming that all of the band 
surrounding the harmonic frequency nf m is taken. When we take only a 
portion of it, 'presumably the statistical properties will tend to approach 
those of a random noise current in accordance with the first statement made 
at the beginning of this section. 

When we apply (4.3-11) to the square law device we have 

F <*0 = ,% 

,(0+) MuR) 



A (R) = -£ f : ^ 

2-Kt J 



=^ 2 

When we apply (4.3-11) to the linear rectifier: 



F(iu) - - —. 

u 2 



Ao(R) = -f / 

lit J-op 



MuR) , aR 

__ du = — 

u 2 T 



where the path of integration passes under the origin. These two results 
agree with those obtained in Section 4.1 and 4.2 from simple considerations. 
As a final example we find the low frequency output of a biased linear 
rectifier in terms of the envelope R of the applied voltage. From the table 
of I'\iu) given in Appendix 4A we see that F{iu) corresponding to 

1 = 0, V < B 

I = V - B, V > B 
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IS 

F(iu) = - 



-iuB 



Consequently, the low frequency output is 



Ao (R) = -J- [^ e- iuD MuR)u- 2 du 
It J-oo 

where the path of integration is indented downwards at the origin. When 
B > R the value of the integral is zero since then the path of integration 
may be closed in the lower half plane by an infinite semi-circle This value 
also follows at once from the physics of the problem. When —R<B<R 
we may integrate by parts and get 

Ao (R) = J- / e- iuB [iBMuR) + RJi(uR)]u~ l du 

= -- + -( [B sin uBMjiR) + R cos uBJx(ugfti* du 

2 ir Jo 



B . B . B 1 /T z5 rrr, 

= + - arc sin -- + - y/R B- 

2 7T K ir 

2 + » \ 2' 2 , 2 , iF 



(4.3-14) 



--? + ?* -5. -5i§'»>- ^<^<^ 



This hypergeometric function turns up again in equation (4.7-6). Also 
in the range —R<B<R, 



dA _ 1 / _ 5* 



When -B is negative and R < -B, the path of integration may be closed 
by an infinite semicircle in the upper half plane and the value of the integral 
is proportional to the residue of the pole at the origin: 



A Q (R) = 2 ^(-2^) ( _ * /3) 



= -B 

Thus, to summarize, the low frequency output for our linear rectifier is, 
for B > 0, (R is always positive) 

Ao(R) =0, R < B 

R n r 1 . (4.3-15) 

Ao (R) = -% + £ arc sin % +-^R--B\ B <R 

2 7T K 7T 
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and for B < it is 

A (R) = | B | , R <\B\ 

A (R) = +IA! + L^- 1 arc sin L?- 1 + - VR* - B\ \B\<R 

L "K K 7T 



(4.3-16) 



where the arc sines lie between and r/2. A (R) and its first derivative 
with respect to R are continuous. 

From (4.3-15), the d.c. output current is, for B > 0, 

he = f T-f + - arc sin | + - V R 2 - B 2 ] />(#) dR (4.3-15) 

Jfi [ Z 7T K IT J 

where />(i?) is the probability density of the envelope of the input V, e.g., 
p(R) is of the form (3.7-10) for noise alone, and of the form (3.10-11) for 
noise plus a sine wave. Similarly, the rms value of the low frequency 
current If/ , excluding d.c, may be computed from 



r 2 _ r 2 . t 2 



where, if B > 0, 



}c= \ \-~ + - arc sin | + - V-K 2 - B 2 \ p(R) dR (4.3-16) 

JB |_ Z 7T K T J 

If V consists of a sine wave of amplitude P plus noise T'. v , so it may be 
represented as (4.1-13), and if P >i> rms V N , the distribution of R is 
approximately normal. If, in addition, P — B^> rms V\> 0, (4.3-15), 
(4.3-16), and (3.10-19) lead to the approximations 



B , B _ . B , 1 /- , * 



/dc *—=+- arc sin - + - V> 2 - -5 2 + 



2 7T /* tt 2irVP 2 - B 2 



i2 



The second expression for idc assumes P » B. When 5=0, these re- 
duce to the first terms of (4.2-5) and (4.2-7). By using a different 
method Middleton has obtained a more precise form of this result. 

Incidentally, for a given applied voltage, 7do(+) for a positive bias | B \ 
is related to 7dc( — ) for a negative bias — | B | by 

/dc(-) = \B\ + Aic(+) (4.3-18) 

Also r.m.s. I ( f(+) is equal to r.m.s. ///( — ). Equation (4.3-18) follows 
from a physical argument based on the areas underneath a curve of I for 
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the two cases. Both of the above relations follow from formulas given by 
Middleton when V is the sum of a sine wave plus noise. They may also be 
derived from (4.3-15) and (4.3-16). 

4.4 Output Power Spectrum 

The remainder of Part IV will be concerned with methods of solving the 
following problem: Given a non-linear device and an input voltage con- 
sisting of noise alone or of a signal plus noise. What is the power spectrum 
of the output? 

In some ways the answer to this problem gives us less information than 
the methods discussed in the first three sections. For example, beyond 
giving the rms value, it tells us very little about the probability density of 
the current corresponding to a given frequency band of the output. On 
the other hand, this rms value may be found (by integrating the power 
spectrum) for any band we choose to study. The methods described earlier 
depended on the input being confined to a relatively narrow band and gave 
information regarding only the entire band corresponding to a given har- 
monic (Oth, 1st, 2nd, etc.) of the input. There was no way to study the 
output when part of a band was eliminated by filters except by obtaining 
the power spectrum of some function of the envelope. 

At present there appear to be two general methods available for the 
determination of the output power spectrum each with its own advantages 
and disadvantages. First there is the direct method which has been used 
by W. R. Bennett*, F. C. Williams**, J. R. Ragazzini 46 and others. The 
noise is represented as the sum of a finite number of sinusoidal components. 
The typical modulation product is computed and the output power spectrum 
is obtained by considering the density and amplitude of these products. 
The chief advantage of this method lies in its close relation to the known 
theory of modulation in non-linear circuits. Generally, the lower order 
modulation products are the only ones which contribute significantly to the 
output power and when they are known, the problem is well along towards 
solution. The main disadvantage is the labor of counting the modulation 
products falling in a given interval. However, Bennett has developed a 
method for doing this. 

The fundamental idea of the second method is to obtain the correlation 
function for the output current. From this the output power spectrum may 
be obtained by Fourier's transform. The correlation function method and 
its variations are of more recent origin than the direct method. They have 

* Cited in Section 4.0. Also much of this writer's work on interference in broad band 
communication systems may be carried over to noise theory without any change in the 
methods used. 

** Cited in Section 4.1. .„«.,„, .-,,,. 

"Proc. I.R.E. Vol. 30, pp. 277-288 (June 1942), "The Effect of Fluctuation Voltages 

on the Linear Detector." 

"B.S.T.J., Vol. 19 (1940), pp. 587-610, Appendix B. 
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been discovered independently and at about the same time, by several 
workers. In a paper read before the I.R.E., Jan. 28, 1944, D. O. North 
described results obtained by using the correlation function. J. H. Van 
Vleck and D. Middleton have been using the two variations of the method 
which we shall describe in Sections 4.7 and 4.8, since early in 1943. A 
primitive form of the method of Section 4.8 had been used by A. D. Fowler 
and the writer in some unpublished material written in 1942. Recently, 
I have learned that a method similar to the one used by Fowler and myself 
had already been used by Kurt Franz in 1941. 48 

The correlation function method avoids the problem of counting the 
modulation products. However, in some cases it becomes rather unwieldy. 
Probably it is best to have both methods in mind when investigating any 
particular problem. The direct method will be illustrated by applying it 
to the square law detector. Two approaches to the correlation function 
method will then be described and applied to examples. 

4.5 Noise Through Square Law-Device 

Probably the most direct method of obtaining the power spectrum W(f) 
of /, where 

/ = aV\ (4.1-1) 

V being a noise voltage, is to square the expression 

M 

V = V N = Yj c m cos (co m t - <p m ) (2.8-6) 

i 

in which c m is 2w(f m )Af, w,„ = 27r/ m ,f m = wA/and ip\ , <p 2 , • • • <Pm are random 
phase angles. 

Considerable simplification of the algebra results when we replace the 
representation (2.8-6) by 

^ = !Z^ MV " (4.5-1) 

Here we have added a term co/2 so as to not have any gaps in the summation 
and have introduced the definitions 

C— m = Cm 

l?-m = —<fm (4.5-2) 

a = 2irAf 

4S "Die tlbertragung von Rauschspannung iiber den linearen Gleichrichter," Hochfr. 
ii. Elektroakust., June 1941. Other articles by Franz are (I am indebted to Dr. North 
for the following references) "Beitrage zur Berechnung des Verhaltnisses von Signal 
spannung zu Rauschspannung am Ausgang von Empfangern", E.N.T., 17, 215, 1940 and 
19, 285, 1942. "Die Amplituden von Gerauschspannungen", E.X.T., 19, 166, 1942. 
The May 1944 (p. 237), issue of the Wireless Engineer contains an abstract of "The In- 
fluence of Carrier Waves on the Xoise on the Far Side of Amplitude-Limiters and Linear 
Rectifiers" by Franz and Vellat, E.X.T., Vol. 20, pp. 183-189 (Aug. 1943). 
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Squaring (4.5-1) gives the double series 

I +00 +00 

T r2 1 X - ' V"* . „ i(m+n)at— if m — i>n 

■t — oo —oo 

1 +00 +°0 

4 !; — — x Jl=— 00 

Suppose we wish to consider the component of V N of frequency /* = feA/. 
It is seen to be 

1 "*"°° 
A k cos (w fc / - fa) = « S c fc-» c » cos (* a ' ~ **-■ "~ *>) (4.5-3) 

— n= — oo 

The power spectrum W(f) of / at frequency f k is a 2 times the coefficient of 
Af in the mean square value of (4.5-3) where the average is taken over the 
<p's. Thus 

2 +oo +oo 

W(fk)&f = jEZ C*-nC»Cjfc_mC M 

4 —oo —oo 

X ave. cos (kat — <ph- n — ip„) cos (£a/ — ^A-m — <Pm) 

where the summations extend over m and «. Let n be fixed and consider 
those values of m which give an average different from zero. We see that 
m = n and m = k — n are two such values. The only other possibilities 
are m = —n and m = —k + n, but these lead to terms containing (except 
when tt'or k equal zero) three different angles, <p n , <pk-n , and <pi^- n which 
average to zero. Using the fact that the average of cosine squared is one- 
half and that for a given n there are two such terms, we get 

4 n=— oo 

= a 2 Af E «»(/* -f,MfnW 

n=— oo 

where in the last step we have used 

/*-» = (k- n)Af = /* - /„ 
and have implied, from c_„ = c n , that 

</■_) = w(-«A/) = «•(-/„) 

is equal to »>(/«). 

Thus, from (4.5-4), we get for the power spectrum of / 



(4.4-5) 



r +» 
W(f) = a 2 / w(x)w(f - x) dx (4.5-5) 

J — oo 
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with the understanding that /is not zero and 

w(-x) = w(x). (4.5-6) 

The result which is obtained by using (2.8-6), involving the cosines and 
only positive values of m, is 

W(f) = a I w(x)w(f - x) dx + 2a f w(x)w(f + x) dx (4.5-7) 
Jo Jq 

This contains only positive values of frequency. (4.5-5) and (4.5-7) are 
equivalent and may readily be transformed into each other. 

The first integral in (4.5-7) arises from second order modulation products 
of the sum type and the second integral from products of the difference 
type. This may be seen by writing the current as 

00 00 

/ = aV~ = a 23 X) c mC n COS (oi m t — <p m ) COS (co„/ — <p n ) 

,„=1 n =l 

00 00 

= ~ 2 £ C m C n {C0S [((Om — CO,,)/ — <p m + <p n ] (4.5~8) 

+ cos [(u m + u n )t + (f m + <p n ]\ 

The power in tlie range//.- ,//„• + A/is the power due to modulation products 
of the difference type, Uk+C — u( , plus the power due to the modulation 
products of the sum type, m-l + wt . In the first type /runs from 1 to oc 
and in the second type C runs from 1 to k — 1. 

Consider the difference type first, and for the moment take both k and I 
to be fixed. The two sets m = k + C, n = /and m = /, n ■ = k -\- I are the 
only values of m and n in (4.5-8) leading to &k+t — ut . The two corre- 
sponding terms in (4.5-8) are equal because cos (— x) is equal to cos x. The 
average power contributed by these two terms is 

( £ c k+ t cA X {Average of (2 cos [{o) k +t - u()t - <pk+t + <piif] 

\ 2 / (4.5-9) 

= %(aCk+(c() 2 

The power contributed to/* ,fk + A/ by the difference modulation products 
is obtained- by summing t from 1 to «: 

i £ cWi = 2a 2 f, wifi+eXftM)* 

2 /•=! (=1 

->2a 2 A/f w(fk + f)w(f) df 
This leads to the second term in (4.5-7). 
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Now consider the modulation products of the sum type. The terms of 
this type in (4.5-8) which give rise to the frequency cot are those for which 
m + n is equal to k. Let n be 1 then m = k — 1. The phase of this term 
is random with respect to all the other terms except the one given by n = 
k — 1, m = 1 which has the same phase. The average power contributed 
by these two terms in (4.5-8) is, as in (4.5-9), 

\{ctCiCk-i) 

This disposes of two terms for which m + " is equal to k. Taking n to be 2 
and going through the same process gives two more. Thus-, assuming for 
the moment that k is an odd number, the power contributed to the interval 
/* ,/fc + 4/ by the sum modulation products is 

1 S («^-») 2 =jE i,ccc n c k - n f -» «A/ w(/)w(A - /) df 

2 n-l 4 n=l •'O 

and this leads to the second term in (4.5-7). 

When the voltage V applied to the square law device is the sum of a noise 
voltage V N and a sine wave : 

V = P cos pt + V N , (4.1-13) 

we have 

V 2 = P 2 cos 2 pt 4- 2PV N cos pt + F 2 , (4.5-10) 

From the two equations 

cos 2 pt = -+- cos 2/tf 

i z Jo 
we see that /, or aV 2 , has a dc component of 

°f 2 +« fwC/)^ (4-5-11) 

2 Jo 



which agrees with (4.1-14), and a sinusoidal component 

°^ cos 2JI (4.5-12) 

The continuous power spectrum W c (f) of the remaining portion of / may 
be computed from 

2PV N cos pt + V%. 
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Using the representation (2.8-6) we see 
u 

2PV N cos pt = ?£ c„,[cos (co m t + pt — <p m ) 4- cos (co m t — pt — <p m )] 
1 

For the moment, we take p = 2irrAf. The terms pertaining to frequency 
/„ = nAf are those for which 

W m + P = 2wf n | 03 m — p | = 2-KJn 

m + r = n | m — r \ = n 

m = n — r m = r =fc n 

where only positive values of m are to be taken : If n > r, then m is n — r 
or r + n. If n < r, then m is r — n or r + «. In either case the values 
of m are | » — r \ and ^i + r. The terms of frequency /„ in 2PV N cos />/ 
are therefore 

PC\ n - T \ COS (27r/„/ — <P\n-r\) + Pc„ +r COS (2x/„/ — <p„ +r ) 

and the mean square value of this expression, the average being taken over 
the <?'s, is 

- {c] n - r \ + C 2 n+r ) = P 2 Af[w(f\ n - r \) + w(f n+r )] 

= P*Af[w(\f n -f P \)+ w(f n +f p )] 

where f p denotes p/2ir. 

By combining this with the expression (4.5-5) which arises from V N 
we see that the continuous portion W c (f) of the power spectrum of / is 

W e (f) = a 2 P\w(f-f p ) + w(f +/„)] 

•+- (4.5-13) 



+ a I w(x)w(f — x) dx 

J— co 



where w(—f) has the same value as w(f). 

Equation (4.5-13) has been used to compute W c (f) as shown in Fig. 8. 
The input noise is assumed to be uniform over a band of width /3 centered at 
f p , cf . Filter c, Appendix C. By noting the area under the low frequency 
portion of the spectrum we find 

Z" 3 

/ Waif) df = a 2 0w o (P 2 + /3w ) 

Jo 

Since the mean square value of the input V N is i/'o = /3wo , it is seen that 
this equation agrees with the expression (4.1-15) for the mean square value 
of Iif , the low frequency current, excluding the d.c. If audio frequency 
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filters cut out part of the spectrum, W c (f) may be integrated over the re- 
maining portion to give the mean square value of the corresponding output 
current. This idea is mentioned in the footnote pertaining to equation 
(4.1-6). 

If V consists of V N plus two sinusoidal voltages of incommensurable fre- 
quencies, say 

V = P cos pt + Q cos qt 4- V N , 

CONTINUOUS PORTION OF OUTPUT SPECTRUM OF SQUARE LAW DEVICE 



INPUT = P COS 2Tlf p -t + NOISE 
OUTPUT D.C.= OL(P z /2* ^ti ) 
LET w|=C 



cc 2 w c (f) 



2P 2 w r 



INPUT SPECTRUM 



INPUT NOISE 

T 



p/ 2 



"T "" 

C/2 



C/2 



FREQUENCY 

Fig. 8 



2fp+0 



the continuous portion W c (f) of the power spectrum of / may be shown to be 
(4.5-13) plus the additional terms 

a?Q 2 [w(f - f q ) + w(f + /,)] (4.5-14) 

where / g denotes q/2r. 
When the voltage applied to the square law device (4.1-1) is 9 

V(t) = Q(l + k cos pt) cos qt + V N 

= Q cos qt + ^ cos (p + q)t + ^ cos (p - q)t + V N 
the resulting current contains the dc component 

i Qi + f ) + a £ w{f) df (4 - 5_i6) 

49 A complete discussion of this problem is given by L. A. MacColl in a manuscript 
being prepared for publication. 
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The sinusoidal terms of I are obtained by squaring 

(2(1 + k cos pt) cos qt 

and multiplying by a. The remaining portion of 7" has a continuous power 
spectrum given by 



= « 2 Q 2 [ 



Wc (f) =a 2 Q 2 \ w(f - f q ) + w(f + /„) 



(4.5-17) 



+ a / w(*)zf(/ — .t) rf# 

J— 00 



where /p denotes ^/2t and/ g denotes q/2w. 

4.6 Two Correlation Function Methods 

As mentioned in Section 4.4 these methods for determining the output 
power spectrum are based on finding the correlation function ^(r) for the 
output current. From this the power spectrum, W(f), of the output cur- 
rent may be obtained from (2.1-5), rewritten as 

W(f) = 4 ( ¥(t) cos 2tt/t dr (4.6-1) 

Jo 

It will be recalled that W(f)Af may be regarded as the average power which 
would be dissipated by those components of I in the band/,/ + A/ if I were 
to flow through a resistance of one ohm. 

The input of the non-linear device is taken to be a voltage V(t). It may, 
for example, consist of a noise voltage V N (t) plus sinusoidal components. 
The output is taken to be a current /(/)• The non-linear device is specified 
by a relation between V(t) and 1(f). In this work /(/) at time / is assumed 
to be completely determined by the value of V(t) at time t. 

Two methods of obtaining ^'(t) will be described. 

(a) Integrating the two-dimensional probability density of V(t) and 
V(t + t) over the values allowed by the non-linear device. This 
method, which is especially direct when applied to noise alone through 
rectifiers, was discovered independently by Van Vleck and North. 

(b) Introducing and using the characteristic function, which for the sake 
of brevity will be abbreviated to ch. f., of the two-dimensional prob- 
ability distribution of V(l) and V(t + r). 
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4.7 Linear Detection of Noise — The Van Vleck-North Method 

The method due to Van Vleck and North will be illustrated by using it 
to determine the output power spectrum of a linear detector when the input 
consists of noise alone. 

The linear detector is specified by 

/ft)-/ ' V(t)< ° (4 7-1) 

/(/) \V(t), V(t) > o, <*•' L) 

which may be obtained from (4.2-1) by setting a equal to one, and the input 
voltage is 

7(0 = V N (t) (4.7-2) 

where V N (t) is a noise voltage whose correlation function is \{/(t) and whose 
power spectrum is w(f). 

The correlation function *(r) is the average value of I(t)I(t + t). This 
is the same as the average value of the function 

F(v v x _ (ViV* . when both V x , V t > , 

^(7i,F 2 )-| 0j all other F's, (4 '' 6) 

where we have set 

Vi = V(t) 

V 2 = V(t + r) 

The two-dimensional distribution of Vi and F 2 is given by (3.2-4), and 
from this it follows that the average value of any function F(V\ , Vz) is 

(4.7-4) 



where 



M I = ^ - *! • 



For the linear rectifier case, where F(Fi , F 2 ) is given by (4.7-3), the 
integral is 

I M I -1 ' 2 J- fWi ( ^FaFxFa exp ["-^r^Fi foVl + foV\ - 2^F 1 F 2 )1 

27r Jo •'o L ^ I ■*"■ I -I 
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where we have used (3.5-4) to evaluate the integral. The arc cosine is 
taken to be between and ir. We therefore have for the correlation func- 
tion of I(i), 

*(r) = ^ ([*o 2 - *;] 1/2 + +* cos" 1 [=^]) (4.7-5) 

The power spectrum W(f) may be obtained from this by use of (4.6-1). 
For this purpose it is convenient to write (4.7-5) in terms of a hypergeo- 
metric function. By expanding and comparing terms it is seen that 






■7 + r + iT + terms Evolving it, it, etc 
4 Ztt 4nyo 



(4.7-6) 



As will be discussed more fully in Section 4.8, a constant term A in ^(t) 
indicates a direct current component of I{t) of -4 amperes. Thus I(t) has 
a dc component equal to 



|~^T" = -±= X rms value of V(t) (4.7-7) 

\_2tTJ V27T 

This agrees with (4.2-3) when the P of that equation is set equal to zero. 
Integrals of the form 



GJJ) = [ i>r cos 2tt/t dr 
Jo 



which result when (4.7-6) is put in (4.6-1) and integrated termwise are 
discussed in Appendix 4C. From the results given there it is seen that if 
we neglect \f/t and higher powers we obtain an approximation for the con- 
tinuous portion W e (f) of W(f): 

w c (f) - (h(fl + G -^P 

(4.7-8) 
w(f) , 1 1 f +ae , . .. w 

4 471-1^0 2 J-oo 

where w(—f) is defined as w(f). 

When V N (t) is uniform over a relatively narrow band extending from 
f a to fb so that w(f) is equal to w>o in this band and is zero outside it, we may 
use the results for Filter c of Appendix 4C. The /o and given there are 
related to f a and / by 

7a — 7° — 2 > 76 — yo -r 2 
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and the value of w taken there is the same as here and is fa/0. The value 
of G 2 (f) given there leads to the approximation, for low frequencies: 

(4./ -9) 



47T V fb - fa) 



when <f<f b -fa, and to W (f) = for/ 6 - /„ < / </« . By setting 
P equal to zero in the curve given in Fig. 8 for W c (f) corresponding to the 
square law detector, we see that the low frequency portion of the power 
spectrum is triangular in shape and is zero at / = (3. Thus, looking at 
(4.7-9), we see that to a first approximation the shape of the output power 
spectrum is the same for a linear detector as for a square law detector when 
the input consists of a relatively narrow band of noise. 

An approximate rms value of the low frequency output current may be 
obtained by integrating (4.7-9) 

Wf = f ° W M df 

Jo 

__ IVpifb — fa) = fa 

Sir 8tt 

rms low freq. current = —te=- X rms applied voltage (4.7-10) 

It is seen that this is half of the direct current. It must be kept in mind 
that (4.7-10) is an approximation because we have neglected xf/ T and higher 
powers. The true value may be obtained from (4.2-8). It is seen that the 
coefficient (8tt)" 1/2 = 0.200 should be replaced by 



K 2 ~ 0" 2 = a209 



We(J) for other types of band pass filters may be obtained by using the 
corresponding G's given in appendix 4C. It turns out that (4.7-10) holds 
for all three types of filters. This is a special case of Middleton's theorem, 
mentioned several times before, that the total power in any modulation 
product (it will be shown later in Section 4.9 that the term ^" in (4.7-6) 
corresponds to the « th order modulation products) depends only on the 
total input power of the applied noise, not on its spectral distribution. 

4.8 The Characteristic Function Method 

As mentioned in the preceding parts, especially in connection with equa- 
tion (1.4-3), the ch. f. of a random variable x is the average value of exp 
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(iux). This is a function of u. The ch. f. of two random variables * and 
v is the average value of exp (iux + ivy) and is a function of u and v. The 
ch. f. which we shall use here is the ch. f. of the two random variables V(t) 
and V(t + r) where Y(t) is the voltage applied to the non-linear device, and 
the randomness is introduced by t being selected at random, r remaining 
fixed. We may write this characteristic function as 

g(u, v, t) = Limit i f exp [iuV(t) -f ivV(t + r)] dt (4.8-1) 

If V(t) contains a noise voltage V N (t), as it always does in this section, and 
if we use the representation (2.8-1) or (2.8-6) a large number of random 
parameters (a„'s and 6»'s or <p n 's) will appear in (4.8-1). In accordance 
with our use of such representations we may average over these parameters 
without changing the value of (4.8-1) and may thereby simplify the integra- 
tion. 

For example suppose 

V(t) = V s (t) + V N (t) (4.8-2) 

where V»(t) is some regular voltage which may, e.g., consist of one or more 
sine waves. Substituting this in (4.8-1) and using the result (3.2-7) that 
the ch. f. of V N (t) and V«(t + t) is 

g N (u, v, t) = ave. exp [iuVx(t) + ivV N (t + r)] 

r * 1 (4.8-3) 

= exp — y (n 2 -f- v 2 ) — \p T uv 

yp T == i//(t) being the correlation function of V N (t), we obtain for the ch. f. 
of V(t) and V(l + 7), 

g(u, v, t) = exp -y (u 2 + v 2 ) - yf/riivj 

X Limit i f exp [iuV.(t) + ivV.(t 4- r)] dt (4 " 8_4) 

= g N (u t v, r)g.(u, v, t) 
In the last line we have used g s (u, v, t) to denote the limit in the line above : 

g s («, v, t) = Limit i I exp [iuV.(t) + ivV.(t + r)] dt (4.8-5) 

T— 00 I JO 

The principal reason we use the ch. f. is because quite a few non-linear 
devices may be described by the integral 

I = — [ F(iu)e iVu du (4A-1) 

27T Jc 
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where the function F(iu) and the path of integration C are chosen to fit the 
device. Examples of such devices are given in Appendix 4A. The corre- 
lation function ^(t) of /(/) is given by 



dt 

dv 



¥(t) = Limit i f /(/)/(/ + r) 

= Limit * f dt f F(iu)e iuV(t) du [ F(iv)e ivVU+T) 

T-»oo 47T" T JO J C » C 

= J_ f F(»«) Jw f F(w) rfp (4.8-6) 

Limit I / exp [««7(0 + »r(< + t)] <fl 

T-»oo T Jo 

= — I F(iu) du I F(iv)g(u, v, t) dv 
■iir- Jc J c 

This is the fundamental formula of the ch. f. method. 

When V{t) is the sum of a noise voltage and a regular voltage, as in 
(4.8-2), (4.8-6) becomes 



* ( T ) = J_ f F(iu)e- l * tmu * du [ F(iv)e 
4ir z Jc J a 



,-(^0/2)v2 

(4.8-7) 
e~* rUV g,(u, v, t) dv 



where g.(u, v, r) is the ch. f. of V„(t) and V,(t + r) given by (4.8-5). This 
is a definite expression for ^(t). All that follows is devoted to the evalua- 
tion of this integral and to the evaluation of 

W(J) = 4 [ ¥(t) cos 2tt/t <*t (4.6-1) 

•to - 

for the power spectrum of I. 

Quite often /(/) will contain dc and periodic components. It seems con- 
venient to deal with these separately since they correspond to terms in 
^(t) which cause the integral (4.6-1) for W(f) to diverge. In fact, from 
Section 2.2 it follows that a correlation function of the form 

A 2 + j cos 2t/ t (2.2-3) 

corresponds to a current 

A + C cos (2tt/o/ - tp) (2.2-2) 



(4.8-8) 



MATHEMATICAL ANALYSIS OF RANDOM NOISE 137 

where the phase angle <p cannot be determined from (2.2-3) since it does not 
affect the average power. 

Consider the correlation function for V(t) = V 8 (t) + V N (t) given by 
(4.8-2). It is 

Limit i\ [ V t (t)V.(t + r)dt+ I V a (t)V N {t + r) dt 

-f f V N (t)V a (t 4- t) dt + j[ V N {t)V N {t + r) dtj 

Since V s (t) and V N (t) are unrelated the contributions of the second and 
third integrals vanish leaving us with the result 

Correlation function of V(t) = Correlation function of V„(t) 

+ Correlation function of V N (t). 

Now as t — * co the correlation function of V N (t) becomes zero while that of 
V s (t) becomes of the type (2.2-3) given above. Hence the correlation func- 
tion of the regular voltage V,(t) may be obtained from V(t) by letting r— > °o 
and picking out the non-vanishing terms. Although we have been speaking 
of V(t), the same results hold for I(t) and this process may be used to pick 
out those parts of *(t) which correspond to the dc and periodic components 
of /(/). Thus, if we look at (4.8-7) we see that as t — > «> , yf/ T -+ 0, while the 
g s (u, v, r) corresponding to V,(t) given by (4.8-5) remains unchanged in 
general magnitude. This last statement may be hard to see, but examina- 
tion of the cases discussed later show that it is true, at least for these cases. 
Thus the portion of ¥(r) corresponding to the dc and periodic components 
of 1(0 is, setting i/v = in (4.8-7), 

*7 T ) = _i- [ F(iu)e- ( * 0l2)u2 du [ F(iv)e- ( *> l2)v *g t (u, v, r) dv (4.8-10) 

47T Jc J C 

where the subscript =o indicates that ^«>(r) is that part of ^(t) which does 
not vanish as r — > «> . 

We may write (4.8-9), when applied to I(t), a$ 

*(t) = *co(t) + *c(t) (4.8-11) 

where ^ c (t) is the correlation function of the "continuous" portion of the 
power spectrum of /(/)• 

Incidentally, the separation of *(t) into the two parts shown in (4.8-11) 
may be avoided if one is willing to use the 8(f) functions in order to interpret 
the integral in (4.6-1) as explained in Section 2.2. This method gives the 
proper dc and sinusoidal components even though (4.6-1) does not con- 
verge (because of the presence of the terms leading to ^(t)). 
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4.9 Noise Plus Sine Wave Applied to Non-Linear Device 

In order to illustrate the characteristic function method described in 
Section 4.8 we shall consider the case of a non4inear device specified by 

I = JL \ F{iu)e iVu du (4A-1) 

2-k Jc 

\ 

when V consists of a noise voltage plus a sine wave: 

V(t) = P cos pt + V N (t) (4.1-13) 

As usual, V N (t) has the power spectrum w(f) and the correlation function 
\(/(t). \P(t) is often written as \f/ T for the sake of shortness. Comparing 
(4.1-13) with (4.8-2) gives 

V s (t) = P cos pt (4.9-1) 

Our first task is to compute the ch. f. g a (u, v, t) for the pair of random 
variables V a (t) and V a (t + r). We do this by using the integral (4.8-5): 

1 C T 
g„(u, v, t) = Limit - / exp [inP cos pt + ivP cos p(t + r)] dt 

t-"x> 1 Jo (4.9—2) 

= Jo(P\/u 2 -f- v 2 H- 2nv cos pr) 

where Jo is a Bessel function. The integration is performed by writing 

u cos pt + v cos p it + t) = (u + v cos />r) cos pt — v sin £t sin pt 



— \/u 2 + v 2 + 2uv cos pT cos (/tf + phase angle) 
and using the integral 

r / \ 1 / „»z cos t ji 

^o(z) = it e dt 

ITT Jo 

The correlation function for (4.1-13) has also been given in Section 3.10. 

The correlation function ^(t) for I{t) may now be obtained by substi- 
tuting the above expressions in (4.8-7) 

*( T ) = J. .[ du F{iu)e-^ mu "- f dv F(iv)e- { *°' 2)v2 

4tt-Jc Jc (4.9-3) 

e~** uv Jo(PVu* + v* + 2uv cos pr) . 

~&oo(t), the correlation function for the d.c. and periodic components of I, 
may, according to (4.8-10), be obtained from this by setting ^ r equal to zero. 
When we have a particular non-linear device in mind the appropriate 
F(iu) may often be obtained from Appendix 4A. For example, F(iu) for a 
linear rectifier is —u~~. Inserting this value in (4.9-3) gives a definite 
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double integral for ^f(r). If there were some easy way to evaluate this in- 
tegral then everything would be fine. Unfortunately, no simple method of 
evaluation has yet been found. However, one method is available which is 
closely related to the direct method used by Bennett. It is based on the 
expansion 

g,(u, v, t) = JoiPVu 2 + v 2 + 2m© cos pr) 

= Z e n (-) n J n (Pu)J n (Pv) cos npr (4.9-4) 

n=0 

6o — lj e n = 2 for n > 1 

This expansion enables us to write the troublesome terms in (4.9-3) as 
e -+ T uv j^py/-* + v i _j_ 2nv C os fr) 

= tt i-r k en cos npr ^J n (Pu)J n (Pv) ^^ 
,i=0 a-=o k\ 

The virtue of this double sum is that it simplifies the integration. Thus, 
putting it in (4.9-3) and setting 

•n+k p 

/,„, = *_ / F(iu)u k J n (Pn)e- (HI2h ' 2 du (4.9-6) 

It J c 



gives 



co co i 

*(r) = ZSt] #*'*«. cos npr (4.9-7) 

„=o fc=o «! 



The correlation function ^(t) for the dc and periodic components of / 
are obtained by letting r — > °° where ^ T — > 0. Only the terms for which 
& = remain : 

^=o(t) = X e„// 2 no cos npr (4.9-8) 

71 = 

Comparing this with the known fact that the correlation function of 

A + C cos (2tt/o/ - <p) (2.2-2) 

is 

C 2 
^ 2 + - cos 2tt/ t (2.2-3) 

and remembering that eo is one while €„ is two for n > 1 shows that 
Amplitude of dc component of / = //oo 

nb (4-9-9) 

Amplitude of -f- component of / = 2// n o 
2tt 



140 BELL SYSTEM TECHNICAL JOURNAL 

Incidentally, these expressions for the amplitudes follow almost at once from 
the direct method of solution. This will be shown in connection with equa- 
tion (4.9-17). 

Since the correlation function ^ c (t) for the continuous portion W c (f) of 
the power spectrum for I is given by 

M> C ( T ) = *( T ) - * M ( T ), (4.8-11) 

we also have 

*c(t) = ZS^i *J*t»*. cos npr (4.9-10) 

7. = fc=l «•' 

When this is substituted in 

WcU) = 4 ( * c (t) cos 2tt/Wt (4.9-11) 

Jo 

we obtain 

™-££$4*(/-*M/+2)] <«■»-«> 

where 

G k (f) = [ tf. cos 2tt/t dr (4.9-13) 

Jo 

is the function studied in Appendix 4C. G k (f) is an even function of/. The 
double series (4.9-12) for W c looks rather formidable. However, when we 
are interested in a particular portion of the frequency spectrum often only 
a few terms of the series are needed. 

It has been mentioned above that the direct method of obtaining the out- 
put power spectrum is closely related to the equations just derived. We 
now study this relation. 

We start with the following result from modulation theory : Let the 
voltage 

V = Po cos .To + -Pi COS X\ + • ■ • + Pn cos x n 

(4.9-14) 

x k = p/J, k = 0, 1, • ■ • N, 

where the pi/s are incommensurable, be applied to the device (4A-1). The 
output current is 

SO 00 

I = 2-i ■■" 2-i l-4„, ... mv em 

mo =0 m N =0 (4.9"l0) 

• • • € mA r cos m x cos *»i«i • • • cos m N x N 

50 Bennett and Rice, "Note on Methods of Computing Modulation Products," Phil. 
Mag. S.7, V. 18, pp. 422-424, Sept. 1934, and Bennett's paper cited in Section 4.0. 



MATHEMATICAL ANALYSIS OF RANDOM NOISE 141 

where e = 1 and e m = 2 for m > 1. When the product of the cosines is 
expressed as a sum of cosines of the angles ;«o .To ± m\ X\ • ■ ■ ±m N x N , it is 
seen that the coefficient of the typical term is A mo ... mN ., except when all 
the m's are zero in which case it is %Ao-.-o . Thus 

^4oo-.-o = dc component of / 

| A mo ... mN | = amplitude of component of frequency (4.9-16) 

— | Wo po ± »h pi ± • • • ± Wat />at I 

Z7T 

For all values of the m's, 

■M /. JV 

A mo ... mN m - F(t«) II/ mr (-Pr«)^ 

IT J c r=0 

M = Wo + Wi + # - • • + m N 

Following Bennett's procedure, we identify V as given by (4.9-14), with 

V = P cos pt + F„ (4.1-13) 

by setting P = P,po= p, and representing the noise voltage V N by the sum 
of the remaining terms. Since this makes Pi , P N all very small, Laplace's 
process indicates that in (4.9-17) we may put 

N 



(4.9-17) 



II MPru) = exp - =- (P\ + • ■ • + Pi) 

r=l 4 



(4.9-18) 



,_ e -<Pou 2 l* 



We have used the fact that \f/ is the mean square value of V N . It follows 
from these equations that 

dc component of I = ~ [ F{iu)HPu)e ( -*° mu2 du 
Zir J c 

Component of frequency ^ = - / F{iu)J n (Pu)e~' l " iu2n du 

Z7T IT J c 

These results are identical with those of (4.9-9). 

The equations just derived show that //„o is to be associated with the n 
harmonic of p. In much the same way it may be shown that h„k is to be 
associated with the modulation products arising from the w 4 harmonic of 
p and k of the elementary sinusoidal components representing V N . We 
consider only combinations of the form pi =fc pi ± pz , taking k = 3 for ex- 
ample, and neglect terms of the form 3pi and 2p! ± p 2 . The former type 
is much more numerous, there being about N 9 of them while there are only 
about N and N 2 , respectively, of the latter type. 
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We again take k = 3 and consider wi ,mi,m% to be one, and m* , • • • wzjv 
to be zero, corresponding to the modulation product up ± Pi ± pz ± pz . 
By making the same sort of approximations as Bennett does we find 

^„.u.i.o.o...o = l —h^h f F(iu)J n (Pu)u*e<- uil2) *°du 

IT O J C 

AP2P3, 

When any other modulation product of the form np ± p ri =fc pr 2 ± pr t is 
considered we get a similar expression in which P1P2P3 is replaced by 
P ri Pr 2 Pr 3 . This may be done for any value of k. The result indicates 
that h n k , and consequently also the (n, k) terms in the double series 
(4.9-10) and (4.9-12) for * c (t) and W c (f), are to be associated with the 
modulation products of order («, k), the n referring to the signal and the k 
to the noise components. • 

We now may state a theorem due to Middleton regarding the total power 
in the modulation products of a given order. For a given non-linear device 
(i.e. F(iu) is given), the total power which would be dissipated by all of the 
modulation products which are of order (n, k) if / were to flow through a 
resistance of one ohm is 

♦ -(0 ) = 'J^fi *■„ = £ i^-' (4.9-19) 

The important feature of this expression is that it depends only on the r.m.s. 
value of Vy and on F{iu). It depends not at all upon the spectral dis- 
tribution of the noise power in the input. 

The proof of (4.9-19) is based en the relation 



*.*(0) = f W nh {f) df 



between the total power dissipated by all the (n, k) order products and the 
corresponding correlation function obtained from (4.9-7). 

This theorem has been used by Middleton to show that when the input 
is confined to a relatively narrow frequency band, so that the output spec- 
trum consists of bands, the power in each band depends only on V N and not 
on the spectrum of V N . 

4.10 Miscellaneous Results Obtained by Correlation Function 

Method 

In this section a number of results which may be obtained from the theory 
given in the sections following 4.6 are given. 
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When the input to the square law device 

/ = aV 2 (4.1-1) 

consists of noise only, so that V = V N , the correlation function for / is 

*(t) = a\+\ + 2 *9 (4.10-1) 

where \f/ T is the correlation function of V N . This may be compared with 
equation (3.9-7). When V is general, 

¥(t) - ave. I(t)I(t + t) 

= ave.a 2 F 2 (/)F 2 (/ + r) 

, „ _ . Aiuf(iv? . . ■ (4.10-2) 

= a" X Coefficient of — p - 1 — - in power series expansion 

of ch. f. of V(t), V(t + t) 

where we have used a known property of the characteristic function. An 
expression for the ch. f., denoted by g{it, v, t), is given by (4.8-4). For 
example, when V consists of a sine wave plus noise, (4.1-13), the ch. f. is 
obtainable from (4.9-3). Hence, 

it" v" 
vj>( T ) = Coeff. of -— in expansion of 



"' [(j + *) 



a ; (PV« 2 + v 2 + 2uv cos pr) 
X exp — ~ (m 2 + v) — \f/ T uv 

+ - cos 2pr + 2P-}p T cos pr + 2^ T 



(4.10-3) 



The first two terms give the dc and second harmonic. The last two terms 
may be used to compute W e (f) as given by (4.5-13). 

Expressions (4.1C-1) and (4.10-3) are special cases of results obtained by 
Middleton who has studied the general theory of the quadratic rectifier by 
using the Van Vleck-North method, described in Section 4.7. 

As an example to which the theory of Section 4.9 may be applied we con- 
sider the sine wave plus noise, (4.1-13), to be applied to the p-law rectifier 

/ = o, V < 

(4.10-4) 
/ = V', V > 

From the table in Appendix 4.4 it is seen that 

F(iu) = T(v+ Dim)"- 1 
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and that the path of integration C runs along the real axis from - « to m 
with a downward indentation at the origin. The integral (4.9-6) for h n k 
becomes 



hnk 


i n+k ->- 
2ir 


rfy + l) ( u k " 

-> c 




(£)" 


-k)/2 

x n,2 r(v+ l) 




2 r( 2 


2 J 


X 


2h 





fi( k + " ~ " ;»+!;-«) (4.10-5) 



where the integration has been performed by expanding J n (Pu) in powers 
of u and using 



-au 2 2X-1 j. , • -X.jt -X 



r e —u> u 2x-i du = ie -«* a -* sin X7rr(x) 



= ^- (1 - e- 2X,,r )r(X) (4.10-6) 

«7r«- x " 



o x r(i - x) 



it being understood that arg u = on the positive portion of C. 
From (4.9-9), the dc component of / is 



2r 



q + o /^oV /2 1? z' » 1 ^ 



which reduces to the expression (4.2-3) when v = 1 for the linear rectifier 
(aside from the factor a). 

When the input (sine wave plus noise) is confined to a relatively narrow 
band, and when we are interested in the low frequency output, consideration 
of the modulation products suggests that we consider the difference products 
from the products of order (0, 0), (0, 2), (0, 4), • • • (1, 1), (1, 3), ■ • • (2, 0), 
(2, 2), • • • etc. where the typical product is of order (n, k). The orders 
(0, 0) and (2, 0) give the dc and second harmonic and hence are not con- 
sidered in the computation of W c (f). Of the remaining terms, either (0, 2) 
or (1, 1) gives the greatest contribution to the series (4.9-12) and (4.9-10) 
for W c (f) and ^ c (t). The remaining terms contribute less and less as n and 
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k increase. The low frequency portion of the continuous portion of the 
output power spectrum is iiien, from (4.9-12), 

w c (f) = 4 ;4g 2 (/) + ^ hlGtif) + • • • 

+ i hUGxif - /„) + Gi(/ + /o)] + |, &<%(/ - /o) (4.10-8) 

+ Ga(/ + /o)] + |j Af 2 [G 2 (/ - 2/ ) + G 2 (/ + 2/ )] + • • • 

From Table 2 of Appendix 4C we may pick out the low frequency portions of 
the G's. It must be remembered that G m (x) is an even function of x and 
thatO </«/ . 

As an example we take the input noise Vn to have the same w(f) and 
\J/(t) as Filter a, the normal law filter, of Appendix 4C, so that 

and assume that the sine wave signal is at the middle of the band, giving 
p = 2ir/o . Thus, from (4.10-8), for low frequencies and the normal law 
distribution of the input noise power, 

TI r f r\ 72,2 -/2/4ff2 . 1 ,2 .4 -/2/8<r2 

IIW) = W? h "* oe + 6WS "<»*<"> 

_L 7. 2 J „-/ 2 /2ff 2 ■ f ,2 ,3-/2/6*2 /, ln n \ 

+ aV^ 7 ' 11 ^' + Wolr *"*' (4 - 10_9) 

J_ 7,2 1 2 -/2/4<r 2 I 

Although we have been speaking of the v-law rectifier, equation (4.10-9) 
gives the low frequency portion of W e (f), corresponding to a normal law 
noise power, for any non-linear device provided the proper //„t's are inserted. 

When we set v equal to one in the expression (4.10-5) for h n h we may ob- 
tain the results given by Bennett. Middleton has studied the output of a 
biased linear rectifier, when the input consists of a sine wave plus noise, and 
also the special case of the unbiased linear rectifier. He has computed the 
output for a wide range of the ratios P~/\po , B'/\f/ where B is the bias. In 
order to cover the entire range he had to derive two series for the corre- 
sponding /i n kS, each series being suitable for its particular portion of the 
range. 
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A special case of (4.10-9) occurs when noise alone is applied to a linear 
rectifier. The low frequency portion of the output power spectrum is 

W (f) = — y* (~^ m (~*2)" ' I e -/V*nw* 
7T „,_i mlml a\/4wT 

= +JjC!l \\ e - f2lial + 7T^= e _/2/8ff2 (4.10-10) 

2a L 64 v 2 



1 



-/ 2 /12<r 2 



T 256V3 



■ 



where we have used (4.7-6) and Table 2 of Appendix 4C. 
The correlation function of 

V, = P cos pi + Q cos qt, 

where p and </ are incommensurable, is 

JoiPy/u 1 + J) 2 + 2«z> cos ^>t) X /o((?Vtt 2 + fl 2 + 2«» cos gr) 
From equations (4.9-16) and (4.9-17) it is seen immediately that 

hm = ^ f F(iu)MPu)MQu)e- lu * m *' du (4.10-11) 

is the d.c. component of / when the applied voltage is 

P cos ^ + Q cos ?/ + V N . (4.1-4) 

J. R. Ragazzini has obtained an approximate expression for the output 
power spectrum when the voltage 

7 - V - + V " (440-12) 

V, = <2(1 + r cos pt)cos qt 

is impressed on a linear rectifier. 46 In terms of our notation his expression 
for the continuous portion of the power spectrum is (for low frequencies) 

w m - 1 V \ W °W given by e( * uation I (4 10-13) 

eU) 7r 2 a ? (<2- + 2\fa) L( 4 - 5-17 ) for sc l uare law device J 

The a 2 is put in the denominator to cancel the a 2 in the expression (4.5-17). 
We take the linear rectifier to be 

'-ft. F <°F (4 - lc " 14) 

and replace the index of modulation, k, in (4.5-17) by r. 

40 Equation (12), "The Effect of Fluctuation Voltages on the Linear Detector," Proc. 
I.R.E., V. 30, pp. 277-288 (June 1942). 
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Ragazzini's formula is quite accurate when the index of modulation r is 
small, especially when y = (f/flfo) is large. To show this we put r = 
in (4.10-13) and obtain 



(4.10-15; 



Wc(f) = *(g + 2gg [ Q2w(/fl _/) + ^*C/« +/) 

+ / w(x)w(J — x) dx 

where /, = q/{2ir). This is to be compared with the low frequency por- 
tion of W%(/) obtained by specializing (4.10-8) to obtain the output power 
spectrum of a linear rectifier when the input consists of a sine wave plus 
noise. The leading terms in (4.10-8) give 

W e if) = tiMf g -f) + w(f q + /)] 



+ *£/ 



+=0 , (4.10-16) 

w(x)w(f — x) dx 



The values of the It's appropriate to a linear rectifier are obtained by set- 
ting v = 1 in (4.10-5) and noticing that Q now plays the role of P. 

*i-<fa*)- a Vi(i;l;-j) (4 - 10 ~ 17) 

y = Q 2 /Vh) 

Incidentally, the first approximation to the output of a linear rectifier 
given by (4.10-16) is interesting in its own right. Fig. 9 shows the low fre- 
quency portion of W c (f) as computed from (4.10-16) when the input noise 
is uniformly distributed over a narrow frequency band of width /3,/ g being 
the mid-band frequency. // u and // 02 may be obtained from the curves 
shown in Fig. 10. In these figures P and x replace Q and y of (4.10-17) in 
order to keep the notation the same as in Fig. 8 for the square law device. 
These curves may also be obtained from equations (33) to (43) of Bennett's 
paper. 

The following values are useful for our comparison. 

When * = When x is large 

J 'n = //„ = 1/tt (4.10-18) 

ftoa = (27nAo)" 1/2 //02 = \/{rQ). 

The values for large x are obtained from the asymptotic expansion (45 — 3) 
given in Appendix 45. 
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Fig. 10— Coefficients for linear detector output shown on Fig. 9 



Ph* = J- M\\ i; -*) /'" = 2\/- im ' 2; _a:) 

We make the first comparison between (4.10-15) and (4.10-16) by letting 
Q — » cc. It is seen that both reduce to 

W c (f) = i Wf f - /) + K»(A + /)] (4.10-19) 



MATHEMATICAL ANALYSIS OF RANDOM NOISE 149 

which shows that the agreement is perfect in this case. Next we let Q = 0. 
The two expressions then give 

W C (J) = jfiT l m w(*W ~ «) dx 

where A = r for Ragazzini's formula and A = 4 for (4.10-16). Thus the 
agreement is still quite good. The limiting value for (4.10-16) may also 
be obtained from (4.7-8). 

Even if the index of modulation r is not negligibly small it may be shown 
that when Q — > a> W c (f) still approaches the value given by. (4. 10-19). 
Ragazzini's formula gives a somewhat larger answer because it includes the 
additional terms, shown in (4.5-17), which contain £ 2 /4, but this difference 
does not appear to be serious. If the Q~ + 2\f/o in the denominator of (4.10- 
13) be replaced by Q" + \Q"k -f- 2^0 the agreement is improved. 

APPENDIX 4A 
Table of Non-linear Devices Specified by Integrals 

Quite a number of non-linear devices may be specified by integrals of the 
form 

/ = _L I F(iu)e iVu du (4A-1) 

Z7T J c 

where the function F(iu) and the path of integration C are chosen to fit the 
device.* The table gives examples of such devices. Some important cases 
cannot be simply represented in this form. An example is the limiter 

I = - aD, V < -D 

I = aV, -D < V < D 

I = aD, D < V (4A-2) 

which may be represented as 



sin Vu sin Du — - 



2a r . 
= — sii 

IT Jo 

2a f iVu . du 

= -aD + — . / e sin Du — 

2tti Jc tr 



(4A-3) 



where C runs from — or to -f- cc and is indented downward at the origin. 
This is not of the form assumed in the theory of Part IV. However it 
appears that it would not be difficult to extend the theory in the particular 
case of the limiter. 

* Reference 50 cited in Section 4.9. 
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Non-Linear Devices Specified by Integrals 

1 = — [ F(iu)e iVu du 

2t Jn 



I = aV", n integer 



I = a(V - B)», n 
integer 



1 = 0, V < 

I = aV, < V 



1 = 0, V < B 

i = a(V - B) v , 
V > B 
v any positive number 



7 = 0, V < 
I = aV, 0<V <D 
I = aD, D < V 



I = 0, V < 

/.= <p(V), V>0 



F{in) 



n\ 



(iu)»< 



(my 






*(1 



- p-i"D> 



HP) 



-r 



e-p'<p{t) dt 



Positive Loop 
around u = 



Positive Loop 
around « = 



Real u axis from 
— co to + oo with 
downward in- 
dentation at 
m = 



Type of Device 



«th power device 



nth power device 
with bias 



Linear rectiher 
cut-off at 
V = 



j/th power recti- 
fier with bias 



Linear rectifier 
plus limiter 



APPENDIX 4B 

The Function \Fi{a; c; x) 
In problems concerning a sine wave plus noise the hypergeometric func- 
tion 



l F 1 (a; C ;z) -1+^1 + 7^+1)2! + 



(4B-1) 



arises. Here we state some of its properties which are of use in the theory 
of Part IV. Curves of iF x (a; c; z) are given for a = - 4, — 3.5 • • • , 3.5, 
4.0 and c = - 1.5, - .5, + .5, 1, 1.5, 2, 3, 4 in the 1938 edition, page 275, 
of "Tables of Functions", by Jahnke and Emde. A list of properties of the 
function and other references are also given. In addition to these refer- 
ences we mention E. T. Copson, "Functions of a Complex Variable" (Ox- 
ford, 1935), page 260. 
If c is not a negative integer or zero 



!Fi(a; c; z) = e\Fi(c — a; c; — z). 



(4B-2) 
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When R (z) > we have the asymptotic expansions 
iFi(a; c; s) ~ ^t-t— ■ 1 + 



r(fl)s c -° L l!z 
, (1 - a) (2 - a)(g - a)(c - a + 1) , 
+ m + 






-c) 



(4B-3) 



fl (a+ 1)(1 + o - c)(2 + a- c) I 

• "*" 2!z 2 i" -J 

Many of the hypergeometric functions encountered may be expressed in 
terms of Bessel functions of the first kind for imaginary argument. The 
connection may be made by means of the relation 51 

tfi (v +i ; 2v + 1; z\ = 2*T(f + l)rV"l,Q) (4B-4) 
together with the recurrence relations 





F<* 


F<^ 


Fc + 


F c - 


F 


1. 


a 


(a - c) 






c — 2a — z 


2. 


ac 




(c — a)z 




— c{a -f- z) 


3. 


a 






1 - c 


c — a — 1 


4. 




— c * 


' —z 




c 


5. 




a — c 




c- 1 


I — a — z 


6. 






(c — a)z 


c(c - 1) 


c(\ — c — 2) 



For example, the first recurrence relation is obtained from line 1 as follows 
aF(a + 1; c; z) + (a - c)F(a - 1; c; z) 

+ (c - 2a - 2)F(a; c; 2)= (4B-5) 

These six relations between the contiguous 1F1 functions are analogous to 
the 15 relations, given by Gauss, between the contiguous 2 Fi hypergeometric 
functions and may be derived from these by using 

iFi(oj c; 2) = Limit tf/o, b; c; |J (4B-6) 

A recurrence relation involving two i/'Ys of the type (4B-4) may be ob- 
tained by replacing a by a + 1 in the relation given by row four of the table 

51 G. N. Watson, "Theory of Bessel Functions" (Cambridge, 1922), p. 191. 
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and then eliminating iF x (a + 1 ; c; z) from this relation and the one obtained 
from row 3 of the table. There results 

*,(«; c- z) = ^(a; c - 1; z) + ^-^ F(a + 1; c + 1; f) (4B-7) 

Setting »/ equal to zero and one in (4B-4) and a equal to }, c equal to 2 in 
(4B-7) gives 

*.Q;3;.)-*rV/.(|) (4B-8) 

Starting with these relations the relations in the table enable us to find 
an expression for x Fi(w + |; m; s) where w and w are integers. A number 
of these are given in Bennett's paper. In particular, using (4B-2), 



A (_» ;!;-.) -.-[(1 +47.(|) + *(§) 



(4B-9) 



APPENDIX 4C 

The Power Spectrum Corresponding to ^" 
Quite often we encounter the integral 

G„(/) = f l>(r)] n cos 2,t/Wt (4C-1) 

where \f/(r) is the correlation function corresponding to the power spectrum 
w(f). From the fundamental relation between w(f) and ${t) given by 
(2.1-5), 

G 1 (f) = ^ (4C-2) 

The expression for the spectrum of the product of two functions enables us 
to write GJJ) in terms of w(f). We shall use .the following form of this 
expression: Let F r (/) be the spectrum of the function <p r (r) so that 

or(r) = [" Frif)e MfT df> r = l, 2 



.+00 



Fr(f) = [ " MtV"* 

J— 00 



dt 
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Then 

f <Pi(T)<p2(T)e-' 2 * i/T dr = I F,{x)F 2 {f - x) dx (4C-3) 

J — QO J- — 00 

i.e., the spectrum of the product ^i(t)^2(t) is the integral on the right. 
If <pi(t) and ip 2 (r) are real even functions of t, (4C-3) may be written as 

/ Pi(r)*» a (r) cos lirfr dr = ^j_ F 1 (x)F 2 (J - x) dx (4C-4) 

In order to obtain G 2 (f) we set <p\(r) and <pi{r) equal to yp{r). We may- 
then use (4C-4) since \p(r) is an even real function of r. When <p t {t) is an 
even real function of r we see, from the Fourier integral for F r (f), that F r (f) 
must be an even real function of /. We therefore set 

2F r (f) = w(f), r = 1, 2 

and define w(f) for negative/ by 

w(-f) = w(f) (4C-5) 

Equation (4C-4) then gives 

GtU) =\ [ w(x)w(f - x) dx 

= I I w(x)w(J - x) dx (4C-6) 

8 Jo 

i r 

+ - J w(x)w(f + x) dx 

where in the second equation only positive values of the argument of w(f) 
appear. 

In order to get Gz(f) we set <pi(t) equal to ^(r), 2Fi(f) equal to w(f), and 
<Pi{r) equal to ^ 2 (r). Then 

Ftif) = 2 / ^ 2 (t) cos 2tt/t </t 
Jo 

= 2G 2 (J) 

and from (4C-4) we obtain 

Gzif) = \ [ w(x)G*(J - x) dx 

(4C-7) 
l r +M r +=0 

= — / w(.r) </# / w(y)w(J — y) dy 

16 J-w J-M 
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Equation (4C-7) suggests that we may write the expression for G 2 (f) as 

G 2 (f) = i [ +W w{x)Gi(J - x) dx (4C-8) 

L J— oo 

This is seen to be true from (4C-2) and (4C-6). In fact it appears that 

Gn (f) = 1 [** w(f - x)G n -i(x) dx (4C-9) 

L J— oo 

might be used for a step by step computation of G n (f). 

We now consider G n (f) for the case of relatively narrow band pass filters. 
As examples we take filters whose characteristics give the following w(f)'s 
and ^(t)'s 

Table 1 



Filter 


w(f) for / > 


Hr) 


a 


*° e -(/-/0) 2 /2<x 2 

foot 1 


<M -2(T<rr)2 COS 2nf T 
^ oe -2»alrl CQS 2lr / oT 

sin 7r/3r ^ r 


b 


■k a 2 + (/ - /o) 2 
a»(/) = wo = \fo//3 for 

/o-2 </</o + f 
m(/) = elsewhere 


c 


7ri3r 



We shall refer to these filters as Filter a, Filter b, and Filter c, respectively. 
All have /o as the mid-frequency of the pass band. The constants have 
been chosen so that they all pass the same average power when a wide band 
voltage is applied: 

^, = / w (f) df = mean square value of I{t) or V{t) 
Jo 

and it is assumed that/o » <r, /o » at, /o » |8 so that the pass bands are 
relatively narrow. 

Expressions for G„(/) corresponding to several values of n are given in 
Table 2. When n = 1, d(/) is simply w(/)/4. G 2 (/) is obtained by set- 
ting » = 2 in the definition (4C-1) for G„(f), squaring the ^(t)'s of Table 1, 
and using 

cos 2 27t/ot = $ + l cos 47r/ r 
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The expression for G 2 (f) given in Table 2 corresponding to Filter c is 
exact. The expressions for Filters a and b give good approximations around 
/ = and/ = 2/ where G 2 (/) is large. However, they are not exact because 
terms involving / + 2/ have been omitted. It is seen that all three G 2 's 
behave in the same manner. Each has a peak symmetrical about 2/o whose 
width is twice that of the original w(f), is almost zero between and 2/ , 
and rises to a peak at whose height is twice that at 2/ . 

Ga(f) is obtained by cubing the \p(r) given in Table 1 and using 

cos 3 27r/br = f cos 2-kJqt + \ cos 6tt/ot. 

From the way in which the cosine terms combine with cos 2t/t in (4C-1) we 
see that G 3 (f), for our relatively narrow band pass filters, has peaks at /o 
and 3/o , the first peak being three times as high as the second. The ex- 
pressions given for Gs(f) and G*(f) are approximate in the same sense as are 
those for G 2 (f) . It will be observed that the coefficients within the brackets, 
for Filters a and b, are the binomial coefficients for the value of n concerned. 
Thus for n = 2, they are 2 and 1, for n = 3 they are 3 and 1, and for n = 4 
they are 6, 4, and 1. 

The higher G„(/)'s for Filters a and b may be computed in the same way. 
The integrals to be used are 

^_ / 2 /2 „, r 2 

e cos zttjt dr = 



I 



i: 



2a-\/2nir 

-2niraT r, r j > Wa 

e cos 2tjt dr = 



27rw 2 a 2 +/ 2 

In many of our examples we are interested only in the values G n (f) for 
/ near zero, i.e., only in that peak which is at zero. It is seen* that G n (f) 
has such a peak only when n is even, this peak arising from the constant 
term in the expansion 

x = J_ [cos 2kx + 2k cos 2(k - i)x + (2 * )(2 _* ,~ 1} cos 2(k - 2)x 

22*.— i [^ zi 

+ ...+ (2 * )! coz2.Tr- (2 * )! 1 

+ + (*-l)|(* + 1)1 C ° S lX + ^!^!2j 



cos 2fc 



